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PREFACE TO THE ENGLISH EDITION 

The English edition does not differ essentially from 
the Polish one. Among the more important supplements I 
should mention 6.5 containing elementary information 
on the notation of mathematical logic. To this supple- 
ment I was inclined by the experience of many years. 
For many students (not for all, perhaps) the notation 
of definitions of certain notions by means of the logical 
symbols makes it easier to understand these notions (e.g. 
the notions of uniform continuity or uniform convergence). 
Besides that, this supplement is included in the book in 
such a manner that it can be omitted in reading the 
whole book. Among other changes introduced in the 
English text, I should mention the addition of a number 
of exercises and problems, the simplification of certain 
proofs, and finally the removal of mistakes which were 
found in the primary text. This has been done with 
cooperation of the translator of this book, Dr. J. Musielak. 
I should like to express here my thanks for his work 
and for the accomplishment of the translation. I express 
also my gratitude to Dr. A. Schinzel, thanking him for 
a number of corrections. 

It is a pleasure for me to inform the reader that 
there will soon be published by Pergamon Press a book 
of problems prepared by Professor I. N. Sneddon and 
Dr. J. Hunter which will serve as an excellent supple- 
ment to this book. 

K. KUKATOWSKI 
Warsaw, March 1960 



PREFACE TO THE POLISH EDITION 

This book contains notes of lectures on differential 
and integral calculus, prepared for publication, which 
I have held for many years in the University of Warsaw. 

The examples at the end of each section form 
a necessary complement of the course. On the other 
hand, the parts of the text marked by a star may be 
omitted at a first reading. 

The first volume contains differential and integral 
calculus of functions of one variable. Function of two 
and more variables, partial derivatives and multiple 
integrals will be treated in the second volume. 

Among the text-books which have been especially 
useful in preparing this book, I should mention those 
by Banach, Courant, Goursat, Hardy, Kowalewski, Ma- 
zurkiewicz, Sierpiriski, Borsuk (a collection of exercises). 

My best thanks are due to my colleagues, Professors 
Karol Borsuk and Wladyslaw Nikliborc and Assistants 
Zygmunt Charzyriski and Eoman Sikorski for their 
numerous suggestions, hints and remarks in preparing 
my lecture for printing. I express my thanks also to the 
Department of Sciences of the Ministry of Education, 
the Editors of the Cooperative "Czytelnik", the Swedish 
Belief Committee and to "Monografie Matematyczne". 
I am very much obliged to them for their assistance 
in the publication of this book. 

K. KURATOWSKI 

Warszawa, October 1946 
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of introduction of real numbers in outline: an axiomatic method 
and another one, which reduces the notion of a real number to the 
notion of a rational number. 
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CHAPTER I 

SEQUENCES AND SERIES 

1. INTRODUCTION 

1.1. Various kinds of numbers 

We shall assume that the notion of a real number 
(i.e. roughly speaking, a number having a finite or in- 
finite decimal expansion) is known from the middle- 
school course (*). We shall recall the terminology and 
some properties of real numbers. 

The numbers 1,2,3,..., are called positive integers. 
The number belongs neither to the positive nor to the 
negative numbers. The fractional numbers, i. e. numbers 

'D 

of the form - , where p and q are integers and q = 0, 

are called also rational numbers. For the rational numbers 
the four arithmetical operations: addition, subtraction, 
multiplication and division (except division by 0) can 

'D 

always be carried out; to the symbol ^ there corresponds 

no numerical value. Thus, the symbol oo, which will be 
often used, does not mean any " infinite" number. 

Geometrically, real numbers may be interpreted as 
points of a straight line upon which are fixed two points 
representing and 1. These two points make it possible 
easily to construct all the rational points on this line, 
w r hich is called the numerical line. For if we are given 
a rational number w, we take a segment of the length w 

(*) In 1.8 and 1.9 of this section, we give two rigorous methods 
of introduction of real numbers in outline: an axiomatic method 
and another one, which reduces the notion of a real number to the 
notion of a rational number. 
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on the right side of (or on the left side, if w is negative). 
The end of this segment is the point corresponding to 
the number w. It is well known that not all points of 
the straight line correspond to rational numbers, e.g. the 
number |/2, i. e. the length of the diagonal of a sqiiare 
with the side equal to 1 is an irrational number. 

Seasons of a geometric as well as of an algebraic 
nature suggest that we include in the notion of number 
all real numbers, i. e. irrational numbers as well as rational 
numbers. Tn this way the scope of algebraic operations 
increases: in the real domain, there exist also roots and 
logarithms of positive numbers. 

It should also be noted that in the real domain not 
all operations can be carried out, e.g. there do not exist 
square roots of negative numbers and, consequently, 
equations of the second degree do not need to possess 
real roots. To avoid situations of this kind, complex 
numbers are introduced. However, we shall not consider 
complex numbers just now. When we use the word 
"number" here we shall always have in mind real numbers. 

1.2. The principle of mathematical induction 

Among the properties of positive integers we shall 
mention the following one which we shall often use. 
It is called the principle of mathematical induction. The 
principle may be stated as follows. 

Let us assume that a property of positive integers is 
given, satisfying the following conditions: 

(i) the number 1 possesses this property, 

(ii) if the number n possesses this property, then the 
number n+1 possesses it, too. 

The principle of induction states that, under these 
assumptions, any positive integer possesses the property 
stated. 

The principle is in agreement with the following in- 
tuitive argument: if the number 1 possesses the con- 
sidered property, then the second condition implies that 
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the number 2 possesses this property; but then, again 
by the second condition, the number 3 possesses this 
property, similarly, this implies that the number 4 pos- 
sesses the property etc. Obviously, we are not able to 
perform this reasoning to infinity. The principle of in- 
duction gives a mathematical formulation to our in- 
tuitive reasoning. 

As an example of the application of the principle of 
induction, we shall quote the proof of the so-called 
Bernoulli ( ! ) inequality: for each positive integer n and for 
any real number a> .1, the formula 

(1) (t + a) n >l+-iM 

holds. 

We begin by noting that the expression x > y means 
that x is greater than // or equal to // or that x is not less 
than y. Thus, 3^2 holds as well as 3 > 3. 

Tn order to prove the Bernoulli inequality by using 
the principle of induction we must show: 

(i) that the number 1 belongs to the set of numbers M 
possessing the property expressed by the inequality (1); 
this is obvious, for substituting the number 1 in place, 
of n in the inequality (I) we obtain the inequality 
1 . + a 5? >l + a which holds for every a; 

(ii) that the formula (1) implies the formula obtained 
from (1) by substitution n+1 in place of n in (1), i.e. the 
formula 



To prove this formula, let us multiply both sides of 
the inequality (1) by 1 + a. Since we have l + a>0 by 
assumption, we obtain 

(1 + a)+ l > (1 + na) (1 + a) - 1 + (n + .1 ) a + na* . 



0) James Bernoulli, a Swiss mathematician in the first half of 
18th century. 
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However, no? > 0; hence 



which yields the formula (I'). 

As a second example of the application of the principle 
of induction we shall give the proof of the following 
trigonometric relation 



. 
sm 



... , 

2sin~ 

w 

satisfied by each integer n > and by any real number t 
which is not an integral multiple of the number 2n. 
In this case, we begin the induction with instead of 1. 

When w=0, formula (2) is an identity -= 



Thus, it remains to prove that formula (2) implies for- 
mula (2') obtained by substitution n+1 in place of n 
in (2). 

Applying formula (2), we may write formula (2') in 
the following form: 



. . 

sin ^ t sin 

(2') 



2 sin - 2 sin 



or (reducing to common denominator) 



rt . t , , ^^ 
= o gin . cos ^,^ +1) ^ . 



But the last formula follows from the known formula 
for the difference of the sine. Hence we have proved 
that identity (2) implies (2'); thus, formula (2) holds for 
each n ^ 0, by the principle of induction. 
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1.3. The Newton (*) binomial formula 

First of all, we shall define the so-called Newton or 
binomial coefficients by the following formula: 



1-2-3.....* 

Thus it is seen that the denominator is a product of 
successive positive integers from 1 to ifc, and the numerator 
is a product of ~k successive decreasing positive integers 
from n to n fc+1- Here we assume n and fc to be positive 
integers and n > Jc. 

We test immediately that (! j = n and ( j = 1. We 

extend the definition of the symbol (?) to the case where 

W 

(n\ 
1 = 1; we adopt this convention to 

simplify the technique of calculations. 

Finally, let us note that (!j is the number of com- 
binations of n elements by fc; we shall not use this fact here. 

The following formula holds (for an arbitrary positive 
integer fc): 



Indeed, 
n- ...-(M 



In the above reasoning we applied the formula (3); 
hence we had to assume that Jc 1 is a positive integer, 
i.e. that k > 1. However, if k = 1, the formula (4) may 
be checked directly, substituting k = 1. 

( l ) Isaac Newton, 1642-1727, one of the most eminent scientists 
in history. One of the inventors of the differential and integral 
calculus. 
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Now, we shall prove the Newton binomial formula, 
i.e. the following formula: 



(5) 

= a" + ("I a""'* + a"" 2 * 8 + ... + (,*) fb* + ... + I") />" . 

\1/ \~/ \/i-/ \M./ 

It is easily seen that the right side is a sum of n+l 
oomponents; the first one is a n and the last one b w , since 

r'\ = 1. This formula is obvious for n = 1. For n = 2 

\nj 

and w == 3 it is known from the middle-school course. 
Since the formula (5) holds for n 1, according to 
the principle of induction, assuming (5), it remains only 
to prove that the formula obtained by substitution ^+1 
in place of n in (5) is true. But (a + h)" + ] -= ( a + b) n (a + b) 
b) n a + (a + b) n b, whence 



+ ab + ()n- l b* + ... 4 ( Jt / I 1 ) w *' ' ' // + ... h ( w !! 1 )oA M + (;;}ft ll+1 
= " +1 -f ("l 1 )^'^ + ... + ( n Z l )a tt - k+l b* + ... + (",t 1 ) fl ' ftM + feU " hl 

where we applied formula (4). The equation obtained 
in this way is just the equation obtained from (5) by 
substitution ^+1 in place of n. Thus, the Newton bi- 
nomial formula is proved. 

We should note that the Newton binomial formula 
may be written in a neater way as follows: 



(0) (a + 6)" 

(when a = ^ ft) ( x ). 



( J ) When a = or 6 = 0, formula (6) may be also applied 
with the restriction that the indeterminate symbol (which is 
obtained for k = n or k = 0) has to be replaced by 1. 
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n 

The symbol means that we must take the sum 

fc-O 

of n+1 terms which are obtained from the expression 
beyond this symbol by substituting successively all integers 
from to n in place of fc, and adding the terms so 
obtained. 

Moreover, the binomial coefficients may be written 
as follows. Let us denote by nl (read: factorial n) the 
product of all successive positive integers from 1 to n: 

(7) nl =1- 2- 3- ... w (and let 0! = 1 by convention). 
It is easily seen that we have 



1.4*. Schwarz inequality 

Applying the principle of induction, we shall prove 
the following inequality: 



For n = 1 the formula (9) is obvious: (x^y^f ^,x\y\. 
Thus, we have to prove this formula for w+1, assuming 
that it is true for n. 

Now, 

(10) (#i2/i + . 



Moreover, 2ab < a 2 + ft 2 , since a 2 + b 2 2ab = (a 
hence, writing a = x k y n+l and b = x n+1 y k , we have 



2x k y k x n+l y n+1 
and suming for k = 1, 2, ..., n, we obtain 
... + x n y n )x n+l y n ^. 1 
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Applying (9) and (10) we get 



(x\ + ... + xl)yl +l + (y\ + ... 



This yields 



But this is just the formula obtained from (9) by sub- 
stituting n+1 in place of n. Thus, the proof is finished. 

1.5. The principle of continuity (Dedekind (*)) 

Among the properties of real numbers, we shall mention 
the so-called continuity principle. This principle states 
that if we divide the set of all real numbers into two 
sets A and B such that any number belonging to the 
set A is less than any number belonging to the set jB, 
then there are two possibilities: either there exists a great- 
est number of the set A or there exists a least number 
of the set B (it being assumed that both the sets are 
non-empty). In other words, if we divide the straight 
line in two parts A and B in such a way that any point 
of the part A lies on the left side of any point of the part B, 
then either there exists a last point in the part A or there 
exists the first point in the part B. No "gap" may be 
found in this "cut" which we have performed. This 
implies the continuity of the set of real numbers dis- 
tinguishing this set from the set of rational numbers, 
where such gaps exist; e.g. dividing the set of rational 
numbers in two parts such that all rational numbers 
< |/2 belong to the first part and all other rational 
numbers, i.e. numbers > j/2, belong to the second part, 
it is easily seen that any number of the first part is less 

( l ) Richard Dedekind, a German mathematician in the second 
half of the 19th century. 
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than any number of the second part, but there does not 
exist any rational number which would be the greatest 
in the first part or the least in the second one (this 
follows from the fact that the irrational number |/2 
may be approximated arbitrarily accurate by the rational 
numbers from below and from above, e.g. by the decimal 
expansions). 

1.6. The absolute value of a number 

The absolute value of a number a, i.e. |a|, is defined 
by the conditions: if a > 0, then |a| = a; if a < 0, then 
|a| = a. The following formulae, known from elementary 
mathematics, hold: 

(11) |a|=|-a|, 

(12) -|a|<a<|a|, 

(13) | 

(14) la|-| 
(15) 

(16) the inequalities |a|<c and \b\^d imply \a 

the proofs will be left to the reader. 

The last formula (16). is the formula for the addition 
of inequalities "under the sign of absolute value" which 
we shall often apply. It follows from the formula (13), 
since |a + 6| < |#| + |&| ^c + d. This formula remains true, 
if the sign < is replaced by <. 

Finally, let us note that 

(17) the inequality \a\<b is equivalent to the double 
inequality b<a<b and hence to the collection 
of two inequalities: a <b and a < b. 

1.7. Bounded sets. The upper bound and the lower bound 
of a set 

We say that a set of real numbers Z is bounded, if 
two numbers m and M exist such that every number x 
belonging to the set Z satisfies the double inequality 
m < x < M . Assuming only that there exists a number M 
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satisfying the inequality M > x for every x belonging to 
the set Z, we call the set Z bounded above. Similarly, 
a set Z is called bounded below if a number m exists 
satisfying the above condition: m < x. 

The geometrical meaning of these ideas is the following. 
If a set is bounded it means that it is contained in a cer- 
tain segment on the numerical line. A set is bounded 
above or below, when it is contained in an infinite radius 
directed to the left or to the right, respectively. 

Applying the continuity principle we shall prove the 
following theorem: 

// a non-empty set Z is bounded above, then among the 
numbers M, satisfying the inequality M > x for any x 
belonging to Z, there exists a least one. This number will 
be called the upper bound of the set Z. 

Similarly, if a set Z is bounded below, then among the 
numbers m, satisfying the inequality m < x for any x 
belonging to Z, there exists a greatest^one, which is called 
the lower bound of the set Z. 

Proof. Let the set Z be bounded above. Let us divide 
the set of all real numbers in two classes as follows. 
To the second class there will belong all numbers M 
satisfying the inequality M > x for any x belonging to Z. 
To the first class there will belong all other real numbers; 
that means that a number a belongs to the first class 
when in the set Z there exists a number greater than a. 
Such a division of the set of real numbers in two classes 
is called a cut, i. e. any number belonging to the first 
class is less than any number belonging to the second one. 
Indeed, supposing a number M of the second class to be 
less than a number a of the first class and knowing that 
a number x exists in the set Z such that a < x we should 
have M < x; but this contradicts the definition of the 
second class. 

Moreover, let us note that both classes are non-empty. 
Indeed, if a number z belongs to the set Z (and such 
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a number exists, the set Z being non-empty by assumption), 
then the number z\ belongs to the first class. The 
second class is also non-empty, since the set Z is bounded 
above. 

According to the continuity principle there exists 
either a greatest number in the first class or a least 
number in the second class. However, the first eventuality 
is not possible. Namely, if a belongs to the first class 
and a < x (where x belongs to Z), then denoting by a' 

ft I / T* 

any number between a and a?, e. g. a' = , we have 

2i 

also a' < x, but this means that a' belongs to the first 
class, too. Thus, to any number a of the first class we 
may find a number a' greater than a in this class. This 
means that in the first class a greatest number does not 
exist. Hence, there exists in the second class a least 
number, i. e. the least number among the numbers M 
satisfying the inequality M > x for every x belonging to 
the set Z. Hence the theorem is proved. 

The proof of existence of a lower bound is completely 
analogous. 

Let us note that the upper bound and the lower bound 
of a set Z do not necessarily belong to this set. E. g. the 
bounds of the open interval ( l ) a < x < b are the numbers 
a and b which do not belong to this interval. 

1.8*. The axiomatic treatment of real numbers 

The notion of a real number which we have assumed 
to be known from the middle-school course may be in- 
troduced in an axiomatic way as follows. 

We assume that in the set of real numbers two 
operations can be performed: addition x + y and multi- 
plication xy. These operations satisfy the laws of com- 



( l ) By an open interval we understand the set of numbers x 
such that a < x < b; by a closed interval we understand the open 
interval together with, ends, i.e. the set of x such that a< x^ b. 



22 I. SEQUENCES AND SERIES 

mutativity and associativity: 



Moreover, the multiplication is distributive with respect 
to the addition: 



Two (different) numbers and 1 are the moduli of 
addition and multiplication respectively, i.e. 



= x , #! = x . 

Further, we assume that in the set of real numbers 
subtraction and division are always possible, except 
division by 0. In other words, we assume that to any 
pair of numbers x and y a number z (called the difference 
xy) exists such that 

x = y + z 

and, in the case where y - 0, a number w (called the 
quotient x : y) exists such that 

x = yw . 

Besides the above axioms concerning the operations, 
we take following axioms concerning the order relation 
x < y. We assume that any two distinct real numbers 
x and y are in this relation in one or another direction, i.e. 
either x < y or y < x. This relation is transitive, i.e. 

the conditions x < y and y < z imply x < z 
and asymmetric, i.e. 

if x < y, then the relation y < x does not hold. 

The order relation is connected with the basic opera- 
tions by the following axiom: 

if y <z, then x + y < x + z and if, moreover, < x, 
then xy < xz. 
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Finally, the last axiom in the theory of real numbers 
which we are accepting is the Dedekind continuity principle 
formulated in 1.5. 

All arithmetic and algebraic theorems known from 
courses in the middle-school may be deduced from the 
above axioms. 

1.9*. Real numbers as sets of rational numbers Q 

The notion of a real number may be defined on the 
basis of the theory of rational numbers as follows. 

Eeal numbers may be considered to be identical with 
sets of rational numbers jR, satisfying the following 
conditions: 

(i) the set R does not contain a greatest number, 
i.e. for any number belonging to the set R there exists 
a greater number in R, 

(ii) if a number x belongs to JK, then any rational 
number less than x belongs to JB; 

(iii) the set R is non-empty and is not equal to the 
set of all rational numbers. 

For real numbers defined in this way we define first 
of all the relation of order. Namely, we write E < R', 
when the set B is a part of the set .R' (different from -R'); 
or, when the set R' contains numbers which do not belong 
to R (it is easily seen that for any two sets satisfying 
the conditions (i)-(iii) always one is contained in the 
other). Both these definitions are equivalent. 

We easily find that the order relation defined in this 
way satisfies the axioms given in 1.8, i.e. it is a transitive, 
asymmetric relation which holds for any pair of different 
sets R and R' in one or other direction. 

Now we define the addition of real numbers, i.e. the 
addition of sets R and R' (satisfying the conditions 



(*) We give here an outline of the so-called Dedekind theory 
of real numbers. 
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(i)-(iii)). Namely, by R + R' we denote the set of all 
numbers which are sums of two numbers, the first of 
which belongs to R and the second one belongs to R'. 
It is easily seen that the set R + R' satisfies the conditions 
(i)-(iii). Moreover, the axioms concerning the addition 
(commutativity, associativity etc.) are satisfied. The real 
number is defined as the set of all negative rational 
numbers. Similarly, the real number 1 is the set of all 
rational numbers less than the rational-one. In general, 
if r is a rational number, then we understand by "the 
real number r" the set of all rational numbers less than 
the rational number r (in practice, we identify the rational 
number r and the real number r). R means the set of 
all rational numbers of the form #, where x takes all 
values which do not belong to R; however, if the set of 
numbers not belonging to R contains a least number r, 
then we do not include the number r in the set R 
(that is the case, when R is "the real number r"). One 
may prove that R + (R) = 0. 

The multiplication of real numbers will be defined in 
the following way: if R > and R' > 0, then RR' is the 
set containing all negative rational numbers and numbers 
of the form rr', where r is a non-negative number belong- 
ing to R and, similarly, r' is a non-negative number belong- 
ing to R'. Moreover, we assume 

(-fi)(-fi') = RR', (-R)R' = - (RR f ) = R(-R') . 

It may easily be proved that all the axioms con- 
cerning the multiplication are then satisfied. 

Finally, the continuity axiom is satisfied. Indeed, 
let A, B denote a cut in the domain of real numbers. 
We denote by R the set of rational numbers with the 
property that r belongs to R if and only if it belongs 
to one of the real numbers belonging to the class A. 

It is proved that the above defined set R satisfies 
the conditions (i)-(iii), so that it is a real number. Then 
we prove that R "lies on the cut A , ", i.e. that it is 
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either the greatest number in the set A or the least 
number in the set B. 

Thus, we see that, if wfc understand by a real number 
a set of rational numbers satisfying the conditions (i)-(iii), 
then all axioms of the theory of real numbers formulated 
in 1.8 are satisfied. 

Let us add that the set of all rational numbers satis- 
fies all these axioms with the exception of one axiom, 
namely the continuity axiom. 

Hence it follows that the continuity axiom is in- 
dependent of the other axioms of the theory of real 
numbers; for if it were a consequence of the others 
(i.e. a theorem and not an axiom), then it would be 
satisfied in every system in which the other axioms are 
satisfied. 

Exercises on 1 

1. Prove that for each positive integer n and for any 
real a > 1 the following formula holds (being a gener- 
alization of the Bernoulli formula (1)): 



Hint: proof by the mathematical induction. 
2. Prove the identities: 



2 ' 



Hint: in the proof of the second equality one may 
apply the identity: 



3. Similarly: find the formula for the sum 
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4. Deduce the formulae: 



apply the Newton binomial formula. 

5. Applying the continuity principle prove that y 'a 
exists for each positive integer n and for any positive a. 

6. Prove that ||a| 16|| < \a b\. Prove that the equa- 
tion \a + b\ = |a| + |ft| holds, if and only if ab > 0. 

7. Denote by A and G the arithmetic and the geometric 
mean of the numbers %, a 2 , ..., a nj respectively, i.e. 



Prove that if the numbers %, a 2 , ..., a n are positive, 
then G^A. 

Hint: precede the proof by the remark that if a x < A 
< a 2 , then the arithmetic mean of the numbers A,a 1 + 
+ a 2 A , a 3 , a 4 , . . . , a n is A and the geometric mean of these 
numbers is > G. 

8. Denoting by H the harmonic mean of the above 
numbers %, a 2 , ..., a n , i.e. writing 



a 2 a 

prove that H < G. 



2. INFINITE SEQUENCES 

2.1. Definition and examples 

If a real number corresponds to each positive integer, 
then we say that an infinite sequence is defined. 

For instance, positive even numbers constitute an 
infinite sequence 2, 4, 6, ..., 2n, ...; namely, to the num- 
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ber 1 there corresponds the number 2, to the number 2, 
the number 4, to the number 3, the number 6, and, 
generally, to the positive integer n there corresponds 
the number 2n. 

Usually, we write an infinite sequence in the form 
!, & 2 , ..., a n , ... or {a n }. The numbers appearing in the 
sequence are called the terms of the sequence; the ex- 
pression a n is called the general term of the sequence. 
Thus, for the sequence of positive even numbers the 
general term is 2n; for the sequence of odd numbers 
the general term is 2n 1. 

In an infinite sequence some terms may be repeated. 
E.g. if the number corresponds to the odd positive 
integers and the number 1 to the even positive integers, 
then the sequence 0, 1, 0, 1, ... is obtained. This sequence 
consists of two alternating terms. 

In particular, all terms of a sequence may be identical: 

0,C, 0, ... 

As examples of sequences we shall mention the arithme- 
tic and the geometric progressions. The arithmetic pro- 
gression is a sequence of the form <?, c + d, c + 2d, ..., 
i.e. a sequence with the general term c + (n I)d. Simi- 
larly, the general term of a geometric progression is 

n = eg 71 " 1 - 

A definition of a sequence by induction (i.e. a recur- 
rence definition) is often used. Here, we define directly 
the term %, but a n is defined by means of the earlier 
terms, e.g., write % = 1, a n = 2 an ~ 1 . The first terms of 
this sequence are: 1, 2, 4, 16, 2 16 , ... 

Finally, let us note that it may not always be possible 
to write the general term by means of a formula. For 
example the prime numbers constitute, as is well known, 
an infinite sequence but we do not know any mathemati- 
cal formula defining the n-th prime number. 

Geometrically, we interprete an infinite sequence as 
a set of points on the plane (on which the axis of abscissae 
and the axis of ordinates are given; cf. Fig. 1, p. 30). 
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Namely, the sequence a 1? 2 , ..., a nj ... is the set of points 
(1, aj), (2, a 2 ), ..., (w, a n ), ... For example the set of po- 
sitive integers is the intersection of the straight line 
y = x and of the pencil of straight lines parallel to the 
Y-axis passing through the positive integer points on the 
./Y-axis. Similarly, the sequence with a constant term c is 
the intersection of the above pencil and of the straight line 
parallel to the X-axis. If we take on the straight lines 
of this pencil points with the abscissae and 1, alter- 
nately, we obtain the oscillating sequence 0,1,0,1,... 

As may by seen from the above remarks, an infinite 
sequence and the set of the terms of this sequence are 
two distinct notions: a sequence is a set of points of the 
plane and the set of terms of a sequence is a certain set 
of real numbers, i.e. from the geometrical point of view, 
a set on the straight line. Two different sequences may 
consist of the same terms: the above defined oscillating 
sequence 0,1,0,1,... and the sequence 0,1,1,1,... 
(having at the first place and at all other places 1) 
have the same terms; however, they are sequences with 
fundamentally different properties. 

A sequence is called increasing, if a l < a 2 < a 3 ..., in 
general: if a n <a n+l . Similarly, a sequence is called de- 
creasing, if a n > a n ^ . If we replace the sign < by < 
(or > by , we obtain increasing (or decreasing) se- 
quences in the wider sense, called also non-decreasing 
(or non-increasing) sequences. Increasing and decreasing 
sequences in the wider sense are generally called monotone 
sequences. 

The sequence of even numbers is an increasing se- 
quence, the sequence 1,1,2,2,3,3,... is an increasing 
sequence in the wider sense. The oscillating sequence 
0,1,0,1,... is neither increasing nor decreasing. 

2.2. The notion of limit 

A number g is called the limit of the infinite sequence 
a 1? a 2 > ? n? ... if to any positive number e a number Tc 
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exists such that for n > &, the inequality 

(1) \a n -g\<e, 

holds, i.e. a n lies between g e and </ + e. 

We denote the limit of a sequence by the symbol 

(2) gr^lim^. 

n=oo 

Let us take the sequence with the general term 

a n ag an example of a sequence with a limit, 

n 

i.e. the sequence 2, 1J, 1J, ..., 1^, ... We shall prove 
that 1 is the limit of this sequence. 

Let a number s > be given. We have to choose k 



in such way that for n> k, the inequality 



n+l 



-1 



< e 



n 
would hold, i.e. that - < e. Now, let k be a positive integer 

greater than - . Then we have - < ^ thus, the double 

S K 

inequality - < -= < e holds for n > k. whence - < e. as 

J n k n J 

we set out to prove. 

Let us note that we have proved simultaneously that 

lim - =^ o . 



The number k chosen to the given s depends on e. 
Mostly, if we diminish e, k has to increase (this fact is 
easy to observe in the above example). 

To express this more figuratively, the condition for g 
to be the limit of a sequence a 1? a 2 , ... may be formulated 
as follows: for any s > 0, the inequality (1) is satisfied 
for all sufficiently large values of n. 

A sequence having a limit is called convergent. A di- 
vergent sequence is a sequence which has no limit. As an 
example of a divergent sequence, let us take the sequence 
of all positive integers. Indeed, let us suppose that g is 
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the limit of the sequence of positive integers. Writing 1 
in place of e we have, by (1), the inequality \n g\< 1 
for sufficiently large n; thus n<g+I. Here is a con- 
tradiction, since just the reverse inequality n > g+I holds 
for sufficiently large n. This contradiction shows that 
our supposition that the sequence of positive integers 
has a limit was false. Thus, it is a divergent sequence. 

Similarly, one might prove that the oscillating sequence 
0,1,0,1,... is divergent. 

Further, 

(3) lim c = c , 



n=oo 



i.e. the sequence with constant term c has c as the limit. 



1234 
FIG. 1 

Namely, we have always a n c = 0. Thus, the in- 
equality (1) holds for all n. 

Geometrically, the notion of limit may be interpreted 
as follows. Let a sequence %, a 2 , ... be given (e.g. the 

M . I -1 

sequence with the general term ). Let us imagine 

the geometrical interpretation of this sequence on the 
plane according to 2.1. Let us draw a straight line 
parallel to the X-axis through the point g of the Y-axis 
(e.g. g = 1). Moreover, let us draw two straight lines 
parallel to the last one on two different sides of it but 
in the same distant. The condition that the equality (2) 
holds means that for sufficiently large n (i. e. for n larger 
than a certain fc), all terms of our sequence lie in the 
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strip determined by the two above-defined parallel 
straight lines. 

The above geometrical condition may be easily ob- 
tained from the analytical condition formulated in the 
definition of limit denoting the breadth of the above 
strip by 2e. 

In other words, the condition for the convergence of 
a sequence to g may be formulated as follows: every 
interval with the centre g contains all elements of the 
sequence beginning with a certain index. 

In the above examples we have seen that a sequence 
may have no limit (if it is divergent); the question arises 
whether if a limit exists (thus, if the sequence is con- 
vergent), then it is unique. We shall show that it is 
really the case. 

For let us assume a sequence a x ,a 2 , ... to have two 
different limits g and g f . Then we have \gg'\> 0. Let 
s = ilSfff'l- According to the definition of the limit, 
two numbers Jc and Tc' exist such that for n > & the 
inequality 



and for n > &' the inequality 

(5) \*n-g'\<* 

hold. 

Thus, denoting by m the greater among the twa 
numbers fc and it', the inequalities (4) and (5) hold for 
n > m, simultaneously. Let us add both sides of these 
inequalities under the sign of absolute value (cf. 1 (15)), 
after changing the sign under the absolute value in the 
formula (4). We obtain \gg'\<2e 9 but 2e = \gg'\. 
Thus, we get a contradiction. 

Eemark. It is easily seen that the notion of limit 
is not changed, if we replace in the definition of limit 
the sign > l)j ^ or < })j ^. 
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2.3. Bounded sequences 

A sequence a 1? a 2 ,... is called bounded if the set of 
its terms is bounded, i. e. if there exists a number M 
such that the inequality \a n \ < M holds for all values 
of n. In other words, the inequality M<a n < M is 
satisfied for all terms of the sequence. 

The geometrical interpretation of this condition is that 
the whole sequence (treated as a set on the plane) is 
contained between two straight lines y = M and y = M. 

We say also that a sequence is bounded above if a num- 
ber M exists such that a n < M for all n, i.e. that the 
sequence lies below the straight line y = M . The notion 
of a sequence bounded below can be defined analogously. 
Clearly, a sequence which is bounded above and below 
is simply a bounded sequence. 

EXAMPLES. The sequence 0,1,0,1,... is bounded. 
The sequence of positive integers is unbounded, though 
it is bounded below. The sequence 1, 1, 2, 2, 3, 3, ... 
is neither bounded above nor bounded below. 

THEOREM. Every convergent sequence is bounded. 

Indeed, let us assume that the equation (2) holds and 
let us substitute the value 1 for e. Hence a number fc 
exists such that we have \a n #| < 1 for n>Jc. Since 
\an\-\g\ <\On-9\ (cf. 1 (13)), we have \a n \<\g\+l. 
Let us denote by -M" a number greater than any among 
the following fc+1 numbers: |a x |, |a 2 |, ..., |a&|, |ffj+l- Since 
the last one is greater than |a*+i|, \a k + 2 \ to., we get 
M > \a n \ for each n. Thus, the sequence is bounded. 

2.4. Operations on sequences 

THEOREM. Assuming the sequences %, a 2 , ... and 6 1? 6 2 ? 
to be convergent, the following four formulae hold( l ): 

(6) lim (a n + 6) = lim a n + lim b n , 

(7) lim(a n -6 n ) = lima n -limfe n , 



( x ) To simplify the symbolism we shall often omit the equality 
oo under the sign of lim. 
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(8) lim (a n - b n ) = lim a n - lim b n , 



(9) lim^ = (when }imb n ^ 0). 

o n Jim o n 

This means that under our assumptions the limit of 
the sum exists and is equal to the sum of limits, the limit 
of the difference exists and is equal to the difference of 
limits etc. 

Proof. Let us write lima n = g and lim b n = h. A num- 
ber s > let be given. Hence a number Jc exists such 
that the inequalities \a n g\ < e/2 and \b n h\ < e/2 hold 
for n > fc. We add both these inequalities under the 
sign of absolute value. We obtain 



This means that the sequence with general term c n a n + b n 
is convergent to the limit g + h. Thus, we have proved 
the formula (6). 

In particular, if b n takes a constant value: b n = c, 
formulae (6) and (3) imply: 

(10) lim(a n + c) == c-flima n . 

Now, we shall prove the formula (8). We have to 
"estimate" the difference \a n b n gh\. To be able to apply 
the convergence of the sequences %, a a , ... and 6 n & 2 , ... 
we transform this difference as follows: 

Unbn gh = a n b n a n h + a n h gh - a n (b n h) + h(a n g) . 

Since the sequence a 19 a 2 , ... i g convergent, it is bounded 
and so a number M exists such that \a n \ < M. Applying 
to the last equation the formulae for the absolute value 
of a sum and of a product we get: 



Now, let us take a number r\ > independently of e. 
Hence a number & exists such that we have \0n g\ < n 



34 
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and \b n h\ < r\ for n > k. Thus, 

\a n b n -gh\ < Jfi? + |% = (M + \h\)f, . 

Till now we have not assumed anything about the 
positive number 77. Let us now assume that r\ = el(M + \h\). 
So we conclude that the inequality \a n b n gh\<e holds 
for n>~k. Thus, we have proved the formula (8). 

In particular, if we write b n = c we get 

(11) lim(c- a n ) = olima n , 

(12) lim( a n ) = lima n , 

where the formula (12) follows from (11) by the sub- 
stitution c = 1. 

Formulae (6) and (12) imply the formula (7), for 



= lim a n + lim ( b n ) = lim a n lim b n . 

Before proceeding to the proof of the formula (9), 
we shall prove the following special case of this formula: 



(13) lim* _!-. 

b n \imb n 



(when limb n ^ 0) . 



First, we note that for sufficiently large n the in- 
equality b n T holds. We shall prove an even stronger 
statement: we have \b n \ > \\h\ for sufficiently large n. 
Indeed, since |&| > 0, a number fc exists such that 
\b n h\<$\h\ for n>Jc. Hence, 

l*|-|frn|<|*-ftnl<t|*| and thus \b n \>$\h\. 
To prove the formula (13), the difference 



h-b n 



\h-b n \ 



has to be estimated. 

But for sufficiently large n we have |A b n \ < 77 and 
:2/|A|. Thus, 

JL_ 1 2r? 

b n ' h h 2 
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Writing 77 = JeA 2 , we get 

1 1 



h 



< 



whence the formula (13) follows. 

The formula (9) follows from (8) and (13): 

a n v 1 ,. T 1 lima n 

^- = lima n =- = kma n lim^ = 
b n b n b n 



Remarks. (a) We have assumed that the sequences 
{a n } and {b n } are convergent. This assumption is essential, 
for it may happen that the sequence {a n + b n } is conver- 
gent, although both the sequences {a n } and {b n } are di- 
vergent; then the formula (6) cannot be applied. As an 
example one can take: a n = n, b n = n. 

However, if the sequence {a n + b n } and one of the 
two sequences, e. g. the sequence {a n } are convergent, then 
the second one is also convergent. For b n = (a n + b n ) a n , 
and so the sequence {b n } is convergent as a difference 
of two convergent sequences. 

Analogous remarks may be applied to the formulae 
(7)-(9). 

(P) In the definition of a sequence we have assumed 
that the enumeration of the elements begins with 1. 
It is convenient to generalize this definition assuming that 
the enumeration begins with an arbitrary positive integer 
(and even with an arbitrary integer), e.g. with 2, 3 or 
another positive integer. So is e.g. in the proof of the 
formula (13). We have proved that b n ^ beginning with 

a certain fc. Thus, the sequence T- is defined just beginning 

o n 

with this Jc (for if b n = 0, then T- does not mean any 

u n 

number). 

This remark is connected with the following property 
of sequences, easy to prove: the change of a finite number 
of terms of a sequence has influence neither on the con- 
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vergence of the sequence nor on its limit. The same can be 
said of the addition or omission of a finite number of 
terms in a sequence. 

EXAMPLES. Find lim - - - . In this case we cannot 

n-oo iW & 

apply the formula (9) directly, since neither the numerator 
nor the denominator are convergent, as n tends to oo. 
However, we can transform the general term of the 



. , ,. , , , 

sequence a n = = - 5 to become a quotient of two ex- 
in o 

pressions each of which has a limit. For this purpose 
it is sufficient to divide the numerator and the deno- 

minator by n. Then we obtain a n = and we may 

apply the formula (9). Since 

lim (e + ~\ = 6 and lim (V- -} = 7 , 

n-oo\ n) n oo\ n) 

we have 



Similarly, 



lim a n = -=. 

n=oo 



.. n+l .. 
hm = hm 



for 



lim - = = lim . 



2.5. Further properties of the limit 

Suppose that a sequence {a n } is convergent. Then the 
sequence (la n |} is convergent, too, and 

(14) lim|on| = | lim On | . 

Let lima n = g. Then we have \a n g\ < e for sufficiently 
large n. Thus, 

0I<-0<fi and - <f-*<e 
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whence (cf. 1 (17)): ||aj-lflf| < Thus, the formula (14) 
is proved. 

Assuming the sequences {a n } and {b n } to be con- 
vergent, the following relation holds: 

(15) the inequality a n ^b n implies Iima n <lim6 n . 

In particular, if the sequence {c n } is convergent, then 

(16) the condition c n ^Q implies lime n >0. 

We shall prove first the last formula. Let limc n = fe, 
and let us further assume that h < 0, i.e. that h > 0. 
Then we have \c n h\ < h for sufficiently large n, and 
hence c n -h< ft, whence c n < 0, which contradicts our 
assumption. 

Applying the formula (16) we shall prove now the 
formula (15). 

We put b n a n = c n . Since a n < b n , we have c n ^ 
and thus, in the limit, limo n > 0. Moreover, (7) implies: 

limtfn = lim& n lima n , 
hence 

limfe^ Hma n > , i.e. lima w <lim6 n 

Eemark. In the formulation of the relation (16), the 
inequality > cannot be replaced by > (similarly, in (15) 
one cannot replace < by <). For example the sequence 
c n = l/n satisfies the inequality c n > 0, but limc? n = 0. 

Thus we see that the relations < and > "remain 
true in the limit", but the relations < and > do not 
possess this property. 

We next prove the formula of the double inequality: 

(17) If a n < c n < b n and if lima n = limfe n , then the se- 
quence {c n } is convergent and limc w = lima n = Iim6 n . 

Suppose that lima n = g = Iim6 and let s> 0. Then 
we have \a n g\ < e and \b n g\<e for sufficiently large n. 
According to the assumption, 

a n -g<c n -g <& n -0, 

and e < a n gr and b n g < s ; 



38 I. SEQUENCES AND SEKIES 

hence e < c n g < e, i. e. \c n g\ < e, whence limc n = g. 

(18) If lim|a n | = 0, then the sequence {a n } is convergent 
and lima n = 0. 

For, we have then \a n \ < a n < \a n \ and 
( |on|) = = li 



2.6. Subsequences 

Let a sequence a lj a 2 , ..., a n , ... and an increasing 
sequence of positive integers w 1? m 2 , ..., m n , ... be given. 
The sequence 

0j = a mi , 2 = dm* ? i On Q*in n j 

is called a subsequence of the sequence a 1? & 2 , ..., a n , ... 

For example the sequence a 2 , a 4 , ..., a 2n , i g a su b- 
sequence of the sequence %, a 2 , ... Yet, the sequence %, %, 
a 2 ,a 2 ,... is not a subsequence of this sequence, since in 
this case the indices do not form an increasing sequence. 

We have the general formula 

(19) m n > n . 

This is obvious for n = 1, i.e. we have m^ ^ 1 (since m l 
is a positive integer). Applying the principle of induction, 
let us assume that the formula (19) holds for a given n. 
Then we have m n+1 > m n > H, whence m n+l > n+1. So we 
have obtained the formula (19) for w+1. Thus, the for- 
mula (19) is true for each n. 

According to our definition, every sequence is its own 
subsequence. We can say in general that every sub- 
sequence is obtained from the sequence by omitting 
a number of elements in this sequence (this number may 
be finite, infinite or zero). Hence it follows also that 
a subsequence {a mjc } of a subsequence {a mn } is a sub- 
sequence of the sequence {a n }. 

THEOREM 1. A subsequence of a convergent sequence is 
convergent to the same limit. In other words, 

(20) if lim a n = g and if m l <m^< ..., then lim a^ = g . 

n oo n oo 



2. INFINITE SEQUENCES 39 

Let a number e > be given. Then a number Tc exists 
such that the inequality \a n g\ < e holds for n> k. Ac- 
cording to the formula (19), m n > n > fc; hence | a mn g \ < e. 
This implies lim a mn = g. 

n=oo 

THEOREM 2 (BOLZANO-WEIERSTRASS (*)). Every bounded 
sequence contains a convergent subsequence. 

Proof. Let the sequence {a n } be bounded. Then 
a number M exists such that the inequality M < a n < M 
holds for each n. 

We shall now apply the theorem from 1.7. Suppose 
that we denote by Z the set of numbers x for which the 
inequality x < a n holds for infinitely many n. The set Z 
is non-empty, since the number M belongs to Z (be- 
cause the inequality M<a n is satisfied by all n). At 
the same time this set is bounded above; for, if x belongs 
to Z, then x < M , since assuming x > M , the inequality 
x < a n would not be satisfied by any n (thus the number x 
could not belong to the set Z). 

Since the set Z is non-empty and bounded above, 
the upper bound of this set exists. Let us denote this 
bound by g. It follows by the definition of the upper 
bound that to any number e > there exist infinitely 
many n such that 

g-e < a n <g + e 

(because g e belongs to the set Z and g + e does not 
belong to Z). 

We shall now prove that g is the limit of a certain 
subsequence of the sequence {a n }. Thus, we have to define 
a sequence of positive integers m l < m 2 < m 3 < ... in such 
a way that lim a mn = g. 

noo 

For this purpose we shall first substitute 1 in place 
of e. Then there exist infinitely many n such that 



(*) Mathematicians of the 19th century. Karl Weierstrass is 
one of the greatest analysts. 
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Denoting one of these n by m 19 we have 
gI <a mi 



Now, let us substitute e = . Then there exist in- 
finitely many n such that g~\<a n ^g + \. Among 
these n there exist numbers > m l ; someone of these n 
we denote by w 2 . So we have 

y | < a 2 <</ + |, w-! < m 2 . 
Similarly, we can find an index m 3 such that g % 



In general, if m n is already defined, we define m n+1 in 
such a way that 



We shall apply formula (17) on the double inequality. 

Since lim- = 0, we have 

n ' 



Hence the formula (21) (after replacing n+I by n) implies 
lim a mn = g. Finally, it follows from the inequality m n 



<m n+ i that the sequence a^, o^, ... is a subsequence 

of the sequence o^o^ ... Thus, the theorem is proved. 

As a corollary from the above theorem we shall deduce 

THEOREM 3. Every monotone bounded sequence is con- 
vergent. Moreover, if ^ < a 2 < ..., then a n ^ lima n ; if 



Let us assume the sequence {a n } to be bounded and 
increasing in the wider sense. Let us denote by Z the 
set of numbers belonging to this sequence and by g its 
upper bound (cf. 1.7). Then we have 

g^a n for each n ; 
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at the same time for any e > there exists a fc such that 
g s < a k (because the inequality g e > a n cannot hold 
for all n, as follows from the definition of the upper bound). 
Since the sequence {a n } is increasing (in the wider 
sense), the inequality n>k implies a k ^a n , whence 
ge<a n . Thus we conclude that to any e>0 there 
exists a fc such that for n > Jc the double inequality 
g e < a n < g holds and so the inequality \a n g\ < e 
holds, too. This means that g = lim a n . 

n*=*oo 

To prove that the inequality a n < g is satisfied by 
each n, let us consider a fixed positive integer n . It has 
to be proved that a nQ < g. Now, it follows from the 
assumptions that 



Thus by the formula (15), a wo < lim a no+k = g. 

k-oo 

In this way the Theorem 3 is proved for non-decreasing 
sequences. The proof for non-increasing sequences is 
analogous. 

It follows at once from Theorem 1 that a convergent 
sequence cannot contain twp subsequences convergent to 
different limits (especially, this implies the divergence of 
the sequence 0,1,0,1,...). For bounded sequences, this 
theorem may be reversed. Namely, we have 

THEOREM 4 ( 1 ). If a sequence {a n } is bounded and if 
all subsequences of this sequence are convergent to the same 
limit g, then the sequence {a n } is convergent to the limit g. 

In other words, every bounded divergent sequence con- 
tains two subsequences convergent to different limits. 

Proof. Let us suppose that g is not the limit of the 
sequence {a n }. Then a number e > exists such that for 
every fc there exists n > ~k such that the inequality 
\<*>n-g\^e holds. Hence we conclude that a subsequence 
exists such that la*^ flf| > e for every n. By sub- 



We shall apply this theorem in 5.5. 
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stituting the value 1 in place of ~k we find that there 
exists m > 1 such that \a mi g\ > e. Further, substituting 
It = m l we find m 2 > m 1 for which [ow, gr| ^ e. Similarly, 
there exists w a > m 2 such that |a ms g\ ^ e etc. 

Since the sequence {a n } is bounded, the sequence 
{a mn } is also bounded. Hence, by the Bolzano-Weierstrass 
theorem it contains a convergent subsequence. Let us 
denote this subsequence by {a mf }. Since it is also a sub- 
sequence of the sequence {a n }, our assumptions imply 

lim a mf = flf, i. e. lim(a mf g) = . 

n oo n noo 

But, on the other hand, the numbers m ri , m rz , ... belong 
to the sequence m 1? m 2 , ... and, consequently, the in- 
equality \a mn 9\^ implies the inequality \a mrn ~-g\^e 
for each n. This contains a contradiction. 

So we have proved that lim a n = g, by leading to 

n oo 

contradiction. 

2.7. Cauchy theorem ( x ) 

A necessary and sufficient condition for the convergence 
of the sequence {a n } is that for every e > a number r exists 
such that the inequality 

(22) \a n -a r \<e 

holds for n> r. 

The proof consists of two parts. In the first one we 
shall prove that the convergence of a sequence implies 
the condition formulated in the theorem, the so-called 
"Cauchy condition"; in other words, we shall prove that 
this condition is a necessary condition for the convergence 
of this sequence. In the second part we shall prove that 



(*) Augustin Cauchy, 1789-1857, one of the most eminent French 
mathematicians. The establishing of fundamental notions and theo- 
rems of the theory of sequences and series and of the theory of 
continuous functions is due mostly to him. 
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if the Cauchy condition is satisfied, then the sequence is 
convergent, i.e. that it is a sufficient condition for the 
convergence of the sequence. 

1 Let ]ima n = g and let e > be given. Then a num- 
ber r exists such that \a n g\ < %e holds for n > r. In 
particular, this inequality holds for n = r, i.e. |a r g\ < \e. 
Adding both these inequalities under the sign of the ab- 
solute value we obtain the formula (22). 

2 Now, let us assume the Cauchy condition to be 
satisfied. We have to prove the convergence of the se- 
quence. First of all we shall prove that it is a bounded 
sequence. The proof will be analogous to the proof in 2.3. 
Namely, we substitute e 1. Then a number r exists such 
that we have \a n a r [ < 1 for n > r. Hence \a n \ \a r \ 
^ \a n a r \ < 1, whence \a n \ < |a r |+l. Let us denote by M 
a number greater than anyone among the following r 
numbers: )%(, |a 2 |, ..., |flf-i|, |o*|+l. So we have M > \a n \ 
for each n. This means that the sequence {a n } is bounded. 

Hence we conclude by the Bolzano-Weierstrass theorem 
that this sequence contains a convergent subsequence. 
Thus, let lim a mn = g, where, m l < m 2 < ... We shall prove 

n oo 

that g = lim a n . 

n=oo 

Now, let e > be given. According to the Cauchy 
condition, a number r exists such that the inequality 

(23) \a n -a r \<%s 

is satisfied for n > r. 

The equation lim a mn = g implies the existence of a Jc 

n=oo 

such that we have 

(24) \a mm -g\ < le 

for n > Jc. Clearly, Jc may be chosen in such way that 
Jc > r. Then both inequalities (23) and (24) are satisfied 
for n > Jc. 
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Moreover, one may replace in formula (23) n by m ny 
since m n ^n>r (cf. (19)). This gives 

(25) \a mn -a r \<%e. 

Adding the inequalities (23)-(25) after changing the 
sign under the absolute value in (25), we obtain the 
inequality \a n g\ < e, valid for each n > k. This means 
that \m\a n = g> 

Eemarks. (a) In the Cauchy theorem as well as in 
the definition of the limit the sign > in the inequality 
n > k as well as the sign < in the formula (22) may be 
replaced by ^ and <, respectively. 

((3) The Cauchy condition may be also formulated as 
follows: for every e > a number r exists such that the 
conditions n> r and n' > r imply \a n a n >\ < e. 

Namely, the Cauchy condition implies the existence 
of an r such that the inequalities \a n a r \ < \e and 
\a n >a r \<^e hold for n>r and ri > r. Adding these 
inequalities we obtain \a n a n '\<. 

2.8. Divergence to oo 

A sequence {a n } is called divergent to oo, if to every 
number r there exists a positive integer Jc such that 
a n > r for n > k. We denote this fact symbolically by 
the equation: lim a n = oo. Thus, a sequence divergent 

w-oo 

to oo is a sequence, in which those terms with sufficiently 
large indices are arbitrarily great. 

Analogously we define the meaning of the expression 
lim a n = oo. It means that for every negative number r 

n=oo 

there exists a Jc such that a n < r for n > k. 

We say that sequences divergent to oo or oo have 
improper limits. 

EXAMPLES: limn = oo, lim( n) = oo. 

n oo ft ^ oo 

1. An increasing (in the wider sense) sequence, un- 
bounded above, is divergent to oo. 
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Indeed, since the sequence {a n } is unbounded above, 
there exists for any r a number k such that a n > a k for 
n > k, whence a n > r. Thus, lim a n = oo. 

71 = 00 

An analogous theorem holds for decreasing sequences. 

Comparing this theorem with Theorem 3, 2.6, we 
conclude that every monotone sequence has a limit, proper 
or improper (depending on whether it is bounded or un- 
bounded, respectively). 

2. If lima n = 00, then lim(l/a n ) =0. 

?ioo n=oo 

Namely, let lima n = oo and let e > 0. Writing r = 1/e 
we conclude that there exists a k such that a n > 1/e 
holds for n > k, i.e. I/a* < e for n > k; but this means 
that lim(l/a w ) = 0. 

The converse theorem is not true: the sequence 
1, |, J, J, ... converges to but the sequence of its 
reciprocals 1, 2, 3, 4, ... is divergent neither to +00 
nor to oo. 

Let us mention the following theorem concerning 
operations on divergent sequences: the sum and the product 
of two sequences divergent to + oo are divergent to + oo. 
We shall prove this theorem in the following form which 
is a little stronger than the above: 

3. If lima w = oo and if the sequence {b n } is bounded 
below , then lim(a n + b n ) = oo. 

Namely, let M<b n . Since lima^ ~ oo, then for 
a given r there exists a number k such that we have 
On> rMtor n> k. Hence a n + b n > r and, consequently, 



4. If lima n = oo and if b n > c always, where c > 0, 
then lim(a n - b n ) = oo. 

Let a number r > be given. There exists a number k 
such that for n > k, we have a n > r/c. Multiplying this 
inequality by the inequality b n > c we obtain a n b n > r. 
Hence lim(a n - b n ) = oo. 
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A theorem corresponding to theorem (15) is the follow- 
ing one: 

5. If lima n = oo and a n < 6 n , then limb n oo. 
Namely, if a n > r, then still more b n > r. 

2.9. Examples 

(a) // c> 0, then lim nc oo. 

noo 

This follows immediately from 4. 
(P) // a > 1, then lim a n = oo. 

l=00 

Namely, writing c = a 1, we get > 0, whence 
lim nc == oo. On the other hand, applying the Bernoulli 

n oo 

inequality (1 (1)), we obtain 

a n ~ (1 + c) n ^ 1 + nc , whence lim a n = oo 

n=oo 

according to 5. 

(r) If M < !? Men linage = 0. 

First, let us assume that < q < 1. Then !/# > 1 
and, consequently, lim (1/g 71 ) = oo. Hence we obtain, ac- 

n-aoo 

cording to Theorem 2, lim g 71 = 0. 

n=oo 

Hence it follows that in the general case, assuming 
only |g| < 1, the equation lim|g| n = is satisfied, 

n=oo 

i. e. lim 12*1 = 0. But the last equation implies lim g 71 = 

n oo oo 

(cf. (18)). 

(S) If a> 0, then lim|/a = 1. 

n*oo 

First, let us assume that a > 1 and let us write 
u n = f/a. We shall prove that the sequence {u n } is de- 
creasing. Indeed, a > 1 implies a n < a n+1 . Taking on both 
sides the n(n+I)-th root we obtain |/a < |/a, i.e. 
w>^n+i- Moreover, the sequence {^ n } is bounded since 
u n > 1. Hence we conclude that it is a convergent se- 
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quence (cf . 2.6, Theorem 3). One has to prove that 1 is the 
limit of this sequence. Let us write lim u n 1 + h. By 
the above cited theorem, u n > 1 implies h ^ 0. We shall 
prove that the supposition h > leads to contradiction. 
Indeed, the inequality 1 + h <]fa yields (I + h) n <a 
and since (1 + A) 71 > 1 + nh, we conclude that ~L-\-nh<a 
for each n. But this is impossible, since lim nh = oo. 

n oo 

So we have proved that a > 1 implies lim ]fa = 1. 

7100 

But if < a < 1, then I/a^l and lim}/l/a = 1, i.e. 

n oo 

lim (l/J/a) = 1. Hence 1/lim j/a = 1, i.e. lim \/a = 1. 

n oo n oo noo 

(e) // |a|<l, then Urn (! + ? + q 2 + ... + q n ~ 1 ) = -^-. 

n-oo J- 2 

This is the expression for the sum of the geometric 
progression with a quotient whose numerical value is less 
than unity. 

] _ tfn, 

Namely, we have 1 + q + q 2 + ... + q 71 * 1 = - and 



^O (cf. (y)). 

(^) If a > and if {r n } is a sequence of rational numbers 
convergent to zero, then lim a r " = 1. 

n=oo 

This is a generalization of the formula (S) and it is 
easily deduced from this formula. 

2.10. The number e 

I l\ n 
We shall prove the existence of lim 1 + - 1 . We shall 

n~oo\ n) 
denote this limit by e. 

I l\ w 
Let us write a n = 1 + - . Then we have 

\ n l 
% = 2 , a 2 = (1 + 1) = {. , a, = (l + i) = |f = 2^. 

We shall prove that this sequence is increasing. For 
this purpose we shall apply the Newton binomial 
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formula ( 1.3): 

1 . n(n-l) 1 , , n(w-l)-...-! 1 



!_i (l-i)(l-*) 
___ -i -1 n \ w/ \ n/ 

= 1 +1 + -gj- H ^ h ... + 

l ~n)'''''( l ~^ 



+ n! 

hence 



n+l/ n+l 
3! 



It is easily seen that the terms of the sum consti- 
tuting a n are less than or equal to the first terms consti- 
tuting a n+1 , respectively. Hence a n < a n+l . 

Thus, the sequence is increasing. But it is also bounded, 
for 



21 ' " ' n\ ' 2 ' 2 2 
since (cf. 2.9, (e)) 

1.1. .1 A 



= 1. 



The sequence {a n }, being increasing and bounded, is 
convergent. Hence the existence of the number e is al- 
ready proved. It can be calculated that, approximately, 
e = 2,718... We may also prove (as we shall show later) 
that 

e = 
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The number e plays a great part in analysis. In par- 
ticular it is used as the base of logarithms (so called 
natural logarithms). 

We shall now prove that 

/ l\ n 1 

(26) lim 1~-) = -. 

n-.oo\ n] e 

Indeed, we have 



n n n 



whence 



T / * , x IT / - 

lim 1 1 H 1 lim I J 

n=oo \ % J-/ n=oo \ 

for 



n ~ l 



1 

e 



. The sequences of the arithmetic means and of the 
geometric means of a given sequence 

Given a sequence a 1? a 2 , ..., a nj ..., let us consider the 
sequence of the arithmetic means 



1. I/ lim a n = flf, J&6W lim - * =? 3; *Ai theorem 



remains true in the case g = 00. 

Proof. First, let us assume that g is a finite number. 
Then, for a given e > 0, a number Tc exists such that the 



50 I. SEQUENCES AND SERIES 

inequalities 

ge< *.+! <g + e, ge <a k+z <gr + e, 

..., ge<a n <g + e 

are satisfied for each n > k. 

Adding the system of these n Jc inequalities we obtain: 



i.e. 

^nk a>k+i + "- + a n / , .nk 

<*-) <-^ <^+ >-ir- 

At the same time, lim - * = 0, whence we 

n=oo W 

have e < - - < e for sufficiently large n. Hence 



, ,1 ... n , ^ 

(g-e) -- e<-^- Z ^< flf + e -- he, 
n n y n 



_ 

but since lim - = 1. we have 
n-oo n 



rl 

for sufficiently large n. 

This means that lim ai + "' + am = g. 

n co W 

Now, let us assume that g = oo (the proof in the 
case g = oo is analogous). Then for a given number 
r > a number Jc exists such that % +1 > r, a^+2 > f? 
Thus, we have a k+l + ... + a n > (n k)r for each n> k, 
whence 



n n 



But we have ~ - - > - for large n\ whence 

n 2t 

.-. + On n-lc r_r Tc 
n n 2~2 n ' 
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whence we obtain - * > - for sufficiently large n. 

n o 

Hence we conclude that 



l ... n 
lim - - = oo . 

n-=oo M 

E em ark. The converse theorem is not true: a se- 
quence may be divergent although the sequence of its 
arithmetic means is convergent. For instance, the se- 
quence 1,0,1,0,... is divergent but the sequence of its 
arithmetic means is convergent to J. 

An analogous theorem holds for the geometric means: 

2. If a n > and lim a n = g (g finite or infinite), then 



lim la^- ... a n = g . 



n oo 



This theorem is proved in a manner completely ana- 
logous to the proof of Theorem 1. Theorem 2 may be 
also reduced to Theorem 1 by taking logarithms (applying 
the continuity of the function log#, cf. 5.5). 

3. If lim (a n+1 a n ) = g, then lim = g. 

n oo n=oo *v 

Indeed, let us write b n = a n a n -i for n>\ and 
fc x = Oj . Then we have 



T T - i - n n 

km 6 n = # and ^- LZ - 1 - = . 



Hence lim = g by Theorem 1. 



4. // a n > and lim -^ = #, then lim y a w = </. 

n-=oo $n noo 

This theorem is obtained from Theorem 2 writing 
= 5- for n > 1 and 6, = a* ; it follows from the 



equation 
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n 4- 1 
EXAMPLES, (a) Writing a n = n, we have lim = 1. 



Hence lim \/n = 1. 

n=oo 

/ i i \ I 

(P) lim \/n\ =00, for lim- = lim (w+1) = oo. 

n=oo n=oo ^ n=oo 

(y) The example of the sequence 1, 1, |, |, J, J, ... 
shows that the limit lim ]/a n may exist, although the 



limit lim -^^ does not exist. 

n=oo n 

Exercises on 2 

1. Evaluate the limits: 



, . 
lim -- - , lim 

n .oo^ + l 

,. 2ro a + 5 ,. 
lim 7- T > lim 






n , . n 

lim 

n-cx, 7^ 



2. Let a convergent sequence {^ n } be given. Prove that, 
if we replace a finite number of terms of this sequence 
by other terms, the sequence obtained in this way is 
convergent, too, and has the same limit as the given 
sequence. 

Similarly: cancellation or addition of a finite number 
of terms to a sequence has influence neither on the con- 
vergence of the sequence nor on the value of its limit. 

3. Prove that if lim a n = and if the sequence {b n } 

n=oo 

is bounded, then lima n b n = Q. 

n=oo 

4. Prove tjiat if the sequences {a n } and {b n } are con- 
vergent to the same limit, then the sequence a l? 6 1 , a 2 , & 2 , ... 
is convergent to this limit, too. 

5. Prove the following generalization of the theorem on 
the limit of subsequences ( 2.6, Theorem 1): if lim a n = g 
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(where g lias a finite or infinite value) and if lim m n = oo, 

n=eoo 

then lim a^ = g. 



w/ 

6. Evaluate lim - y 



7. We define a sequence {a n } by induction as follows: 



Prove that lim a n = jj . 

7l-=00 

8. Let a bounded sequence {a n } be given. Prove that 
among the numbers being limits of convergent subse- 
quences of this sequence there exist the greatest number 
and the least number (these numbers are called limes 
superior and limes inferior of the sequence {a n }, i.e. the 
upper limit and the lower limit of the sequence {a n }, 
respectively). 

Prove that a necessary and sufficient condition of the 
convergence of a sequence is that the upper limit equals 
the lower limit. 

Prove that if c = lim sup a n , then for every e > 
a number fc exists such that a n < c + e for n > Tc and 
that a m > c e holds for infinitely many indices m. 

9. Prove that for every sequence of closed intervals 
such that each interval is contained in the preceding 
one, there exists at least one common point (Ascoli 
theorem). 

In the above theorem closed intervals are considered, 
i.e. intervals together with end-points; show by an ex- 
ample that this theorem does not hold for. open intervals 
(i.e. intervals whose end-points are excluded). 

10. Find the limit of the sequence {a n } defined by 
induction: 
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11. Prove that if lim a n = g and if lim (b 1 + b 2 + ...+ b n ) 

noo n=oo 

= oo, where always b n > 0, then 



ni . , nt 

12. Prove that if lim - = g and lim v n = oo, 

n-oo^n ^n-l n-oo 

where the sequence {v n } is increasing, then lim = gr. 



n oo 



(Substitute in the previous exercise: a n = - -- , 



13. Pascal ( l ) triangle. We consider the following 
table (i.e. double sequence {a nk }): 

1 1 1 1 1 ... 

1 2 3 4 5 ... 

1 3 6 10 15 ... 

1 4 10 20 35 ... 

1 5 15 35 70 ... 



This table is defined as follows: the first line consists 
of nothing but 1, i.e. a ltk = 1; the &-th term in the n-ih 
line is the sum of the first ~k terms of the (n l)-th line, i. e. 

a nk = #n-l,l + a n-l,2 + + a n-l,k 

Prove that 



and that the terms a %i i, n _ 1>2 , ..., a^ n are successive 
coefficients of the Newton expansion of the expression 
(a + 6) 11 "" 1 (as is easily seen they are the terms of the 
table lying on the straight line joining the n-th term 
of the first line with the first term of the n-ih. line). 



( x ) Blaise Pascal, a French mathematician, 1623-1662, known by 
his works which initiated the Calculus of Probability. Newton's 
predecessor in certain researches in Analysis. 
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14. Prove that 



/V+l }/n a + 2 \/n* + nl 

15. Prove that if a sequence of rational numbers 
I 1 (where p n and q n are positive integers) tends to an 
irrational number, then 

lim p n = oo = lim # n . 

n oo n oo 

3. INFINITE SERIES 

3.1. Definitions and examples 

Given an infinite sequence a*, a 2 , ..., a n , ..., we con- 
sider the following infinite sequence: 

If the sequence s 19 s 2 , ..., s n , ... has a limit, then we 
denote this limit by the symbol 



! n-oo 

and we call it the sum of the infinite series o 1 +a a + 



In this case we say also that the series is convergent. 
If the above limit does not exist, then the series is called 
divergent. 

In the case when all terms of the sequence {a n } be- 
ginning with a certain Tc are = we have an ordinary 
sum of a finite number of terms. Thus, the sum of an 
infinite series is a generalization of this sum when the 
number of terms is infinite (which is emphasized by 
the notation). However, in distinction with the addition 
of a finite number of terms, it is not always 
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to find the sum of an infinite number of terms, i.e. the 
sequence (1) is not always convergent (even if we take 
into account infinite limits). 

To illustrate this we shall give several examples. 

The geometric series a + aq + aq 2 + ... + aq n + ... with 
the quotient q satisfying the inequality \q\ < 1 is con- 
vergent. Namely ( 2.9, (e)), 

a + aq + aq 2 + ... = . 




The series 1+1+1 + ... is divergent to oo because 
s n = n. 

The series 1 1+1 1 + ... has neither a proper nor 
an improper limit, for in this case the sequence (1) is 
the sequence: 1,0,1,0,... 

The sequence {s n } will be called the sequence of partial 
sums of the given infinite series. 

By the n-th remainder of the series a 1 + a 2 + ... we 
understand the series 

CO 

(2) r n = ci n+ i + a n +2 + ... = / 1 a m . 

If the series a + a 2 + ... is convergent, then lim r n = 0. 

First of all let us note that if the series 1 + a a + ... 
is convergent, then the series (2) is also convergent for 
each value of n. For 

CO 

r n = lim (a n+1 + a n+2 + ... + a n +k} = lim s n + k s n = 2j a m ~s n , 
whence 

OO OO CO 

limr n = JT 1 a m -lim s n = a m ^ a m = . 

n-co m==1 n=oo muml mssl 

3.2. General properties of series 

We shall now give some properties of infinite series 
which are direct consequences of relevant properties of 
infinite sequences. 
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1. GATJCHY CONDITION. A necessary and sufficient con- 
dition for the convergence of the series a l + a% + ... is that 
for every e > a number fc exists such that the inequality 

(3) |0*+i + 0Jfc+2 + .- + 0*+m| < 

holds for each m. 

Indeed, the convergence of the given series means 
the convergence of its partial sums s u s 2 > ? and the 
Cauchy theorem ( 2.7) implies this sequence to be con- 
vergent if and only if for every s > there is a Jc such 
that for each m the inequality \s k+m s k \<e (i.e. the 
inequality (3)) is satisfied. 

2. If the series a l + a 2 + ... is convergent^ then lim a n = 0. 

noo 

Namely, a n = s n 8 n -i ; hence 

lim a n = lim s n lim s n _i , 

n**oo ?i=oo n=oo 

but 

lim s n -= lim 5 n _x . 

n==cx3 n=oo 

Eemark. Theorem 2 cannot be reversed. Namely, 
there exist divergent series with terms tending to 0. Such 
a series is the harmonic series 

l + ^ + i + ... + - + ... 
2 3 n 

Indeed, 

!+!>i i + i+ 1 + i>i 

3 + 4 > 2' 5 + 6 + 7^8 2' '"' 



2' 



i.e. 



/yt 

Hence s 2n >-~. Thus lim s 2n = oo, whence we conclude 



2n -~. 2n 

n=-oo 



that the sequence of partial sums of the harmonic series 
and so the series itself, are divergent. This is a series 
divergent to oo. 
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A series is called bounded if the sequence of its partial 
sums is bounded, i.e. if a number M exists such that 
M> \s n \ for each n. 

3. Every convergent series is bounded. 

This is an immediate consequence of theorem 2.3. 
We shall give now two theorems relating to operations 
on series: 

4. // the series a l + a 2 + ... and b l + b 2 + ... are con- 
vergent, then 



n 1 n1 

oo oo 



*n-t> n ) = 2j a n- 
n 1 n=l n1 

For 

00 

(a n + b n ) lim (% + b l + a 2 + b 2 + ... + #n + b n ) 

n-l n = 

= Iim(a 1 + a 2 + ... +a n ) + lim (b l - 

n oo n oo 

oo oo 



ni n1 

The proof for the difference is analogous. 
5. // the series a 1 + a 2 + ... is convergent, then 

00 00 

X j ( c ' n) == " / 1 a n . 
n1 n=l 

In particular, 

00 00 

For 

00 

(c-a n ) =lii 
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3.3. Alternating series. Abel theorem 

We call alternating series a series of the form 

(4) a l a 2 + a 3 a 4 + ... , where a n > . 

THEOREM 1. An alternating series (1) satisfying the 
conditions 

(5) a 1 >a 2 >a 3 >... and lima n = 

noo 

is convergent. Moreover, the partial sums s n = a 1 a 2 + 
+ a 3 a 4 + . . . a n satisfy the inequalities 

(6) s 2n < a x - a 2 + a 3 - ... < s 2n+l . 

Indeed, the sequence of partial sums with even indices 
is increasing (in the wider sense), for 

. 



At the same time, it is a bounded sequence, since 

8 2n = %- [(a 2 - a 3 ) + (a 4 - a 5 ) + ... + a 2rl ] < a x . 
Thus, it is a convergent sequence. Let lim s 2n = g. 

n=oo 

To prove the convergence of the series (4), it suffices 
to show that lim s 2n +i = 9- - 



Now, s 2n +i = *2n + 2H+ij whence lim s 2n -K = Iims 2 n + 

n=oo n oo 

+ lim a 2n+1 = g, because lim a 2n+l = by (5). 

n=-oo n=oo 

Finally, the double inequality (6) follows from the 
fact that the sequence {s 2n } is increasing and the sequence 
{SZH+I} is decreasing (cf. 2.6, Theorem 3). 

EXAMPLES. The (anharmonic) series 

(7) l_i + i i + ... 

is convergent. As we shall show later, its sum equals 
to log c 2. 
The series 

(8) i_ t+l _| + ... 

is also convergent (its sum is equal to %n). 
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THEOREM 2 (ABEL ( 1 )). If the sequence {a n } satisfies the 
conditions (5) and if the series b l + b% + ... (convergent or 
divergent) is bounded^ then the series 

(9) aA + a 2 b 2 + ... + a n b n + ... 
is convergent. 

Let us write s n = b l + b^ + ... + />. According to the 
assumptions we have made there exists an M such that 

|| < M. 

To prove the convergence of the series (9), we have 
to estimate the sum 

kb k + <*>k+ibk+i + ... + a n b n 
for n > Tc. For this purpose we note first that 

(10) -2 M <b m + b m+1 + ... + b n < <2M 
for each m and n > w, since 

\b m + ... +b n \ = |,S' n -Sm-l| < | 

Now, 

(11) afcftfe + a^! 6 fc+1 + ... + a n b n 



< 2 M [(a k - 
= 2 Jf a^ 

according to (10). 

Similarly, a k b k + ... + a n b n ^ 2M - a k ; hence 

(12) \a k b k + ... + a n b n \ ^2M-a k . 

Now, let an e > be given. By the equation (5), there 

o 

exists a Tc such that a k < ^^ . As we have proved, the 



inequality (12), i. e. \a k b k + ... + a n b n \ < e, holds for each 
n > fc. According to the Cauchy theorem ( 3.2, Theorem 1), 



00 



this implies the convergence of the series ]? a n b n . 



() Niels Henrik Abel (1802-1829), a famous Norwegian alge- 
braician. 
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Bemarks. (a) It follows from the formula (12) that 



(13) 



Namely, by the formula (12), the inequality [a^ + ... + 
+ <*>nb n \ <2Jf -a t holds for each n. 

(P) Theorem 1 is a special case of Theorem 2. Namely, 
we take the sequence 1, 1, 1, 1, ... in place of the 
sequence {b n }. 

(y) In the formula (11) we have applied the so called 
Abel transformation. It may be written also in the follow- 
ing form: 



3.4. Series with positive terms. D'Alembert and Cauchy 
convergence criterions 



Assuming all the terms of the series a 1 + a 2 + ... to be 
positive, the sequence of its partial sums is increasing. 
Hence it follows immediately that: 

1. A series with positive terms is either convergent or 
divergent to oo. 

2. THEOREM ON COMPARISON OF SERIES. If < b n < a n 
always and if the series o 1 + a a + ... is convergent, then the 
series b l + b 2 + ... is also convergent. Moreover, 



n=*i n=l 

Let s n = a t + a 2 + + #n ? ^n = ^i + &a + + bn Then 

00 

we have t n < s n and, since (cf. 2.6, 3) s n < lim s n = a n , 

n oo nl 

oo 

we have J n < J a n . This inequality proves the bounded- 

n-l 
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ness and so the convergence of the series 

(by Theorem 1); on the other hand, it implies the in- 

oo oo 

equality b n < a n (by 2.6, 3). 

n=l n 1 

Theorem 2 often makes it possible to prove the con- 
vergence of a series in a simple way, b t y*Mfciiyi*i?ison of 
this series with a series the convergence of which is al- 
ready established. For example to prove the conver- 
gence of the series 



we compare it with the series 
(15) 



__ __ ... ___ 
Namely, we have 



At the same time the convergence of the series (15) 
follows immediately from the identity: 

J: + _!_+ | 1 (l l \\ ( l ! ] I + 

1.2 + 2.3 + - + (ti-l)n~\ 1 2/ + \2 3/ + - + 



whence lim s n = 1 . 

n=oo 

The following two convergence criteria for series 
with positive terms are based on the comparison of the 
given series with the geometric series. 



( l ) We shall show later ( 11, (46)) that 1 + + + ... = . 
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3. D'ALEMBERT ( l ) CRITERION. A series 
positive terms satisfying the condition 



(16) Urn *i < 1 , 

n=oo Q>n 

is convergent. 

eoVtdBltf't' 

By e>qftSMm (16) suppose that ft satisfies the inequality 

lim -^ < A < 1. Hence a number Jc exists such that for 



fc we have < A, i.e. a n+1 < a n - h. 



Thus, the series ^ + ^+1 + ^+2 + ... has terms less 
than the terms of the geometric series a k + a k ft + 
+ % ft 2 + ..., respectively. But the last series is convergent 
because < ft < 1. Thus, Theorem 2 implies the con- 

00 

vergence of the series a n and hence of the series 

n-k 

oo 

a n , too. 

4. CAUCHY CRITERION. A series o 1 + o a + ... with positive 
terms satisfying the condition 

(17) lim \/~On < 1 , 

n oo 

is convergent. 

Similarly as before, there exist an ft < 1 and a fc such 
that for n ^ it, we have j/o^ < ft, i.e. a n < h n . Comparing 
the series a k -\-a k+ i + ... with the geometric series ft fc + 
+ h k+l + ...j we conclude the convergence of the first 
series from the convergence of the second one. 

5. DIVERGENCE CRITERIA. // the series a 1 + a 2 + ... with 
positive terms satisfies one of the two inequalities 



(18) lim>l or 

n oo a n 

then the series is divergent. 



( x ) Jean le Rond d'Alembert (1717-1783), a famous French 
mathematician and encyclopaedist. 
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If the first of the inequalities (18) holds, then for 
sufficiently large n we have 

^ > 1 , i.e. a n+l > a n , 
a n 

whence the sequence {a n } does not converge to and 
consequently, the series a 1 + a a + is divergent. If the 
second of the inequalities (18) holds, then for sufficiently 
large n we have ]/a n > 1, i.e. a n > 1 and the sequence 
{a n } is not convergent to 0, neither. 
Bern ark. It may happen that 



In this case our criteria do not determine whether the 
given series is convergent or divergent. Then we are 
dealing with the so called "doubtful" case; we say also 
that the series does not react to the above criteria. 

3.5. Applications and examples 

c n 

1. The series 2, , where c > 0, is convergent. 

n~*l Ifo. 

Indeed, 

c n+l nl c a n +i 

== _ whence lim -^ ~ = . 

' 



a n c n ( 

By d'Alembert criterion we conclude that the given 
series is convergent. 

CO f 

2. The series J ^ is convergent. 

nl a n 1 

Let a n =: -^. Hence -^1= (^+1) 



Thus 



lim ! + i 

n=oo \ n) 
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f>n AJ t 

3. lim^=0 = lim^. 

This merely states that the general term a n of a con- 
vergent series converges to 0. 

Defining a sequence {a n } divergent to oo to tend more 
rapidly to oo than a sequence {b n } if the condition 

lim = holds, we may rewrite Formula 3 in the 

n=oo Q"n 

following way: n\ tends more rapidly to oo than c n , and n n 
tends more rapidly to oo than the factorial nl. 

4. The harmonic series 1 + - + -- + --H (- does not 

23 n 

react to the d'Alembert criterion. The same holds for the 
series (14). 
For, 

lim T = lim -. rr = 1 . 



As we know, the first of the above two series is di- 
vergent and the second one is convergent. 



K -...- . 

5. The series 2j -- - r c ^ convergent 

n=l ^ 

for < c < 1. 

For, we have for non-negative and non-integer x 



I- 1 



n+I i , 1 



Hence lim -"-i 1 - = c. 

n=oo ^n 

The convergence of this series implies 

fl ,. o?(^ !) ... (a? ^+1) . . 

6. lim - - - - ^ - ^ ; c n = for \c \ < 1. 

' ' 



v 

7. Tfte 5^rie ^ ~^ is convergent for c> I (where p is 



an integer). Hence lim = 0. 

n=oo C 
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^ .. ln+l\v (P 1 . 
For, lim = - < 1. 

' n-oo \ n / C"* 1 C 

8. The divergence of the harmonic series and the 
Cauchy criterion imply immediately the formula 

lim }/n = 1. 

noo 

n / 

Since the sequence y n is decreasing for sufficiently 
large n and consists of terms > 1, so lim \/n ^ 1 exists. 

noo 

Supposing lim \n > 1 we should get lim j/l/n < 1 and 

noo n=-oo 

the Cauchy criterion would imply the convergence of 



00 



the series 



Eemark *. The Cauchy criterion is stronger than the 
d'Alembert criterion. For the existence of the limit 



lim -^ implies the existence of the limit lim }/a n (and 

noo Q"n noo 

both these limits are equal one to another, cf. 2.11, 4). 
However, the last limit may exist although the first one 
does not exist. 

3.6. Other convergence criteria 

KUMMER THEOREM ( 1 ). A necessary and sufficient con- 
dition for the convergence of the series a 1 + a a + - wffli 
positive terms is that a sequence of positive numbers 6 1? 6 2 , ... 
exists such that 

(19) 



noo \ a n+l 

In order to prove the necessity of the condition for- 
mulated in the theorem let us assume the convergence 

s s 

of our series and let us write b n = - - , where s is the 

a n 



( l ) Ernst Kummer, a famous Grerman mathematician of 19th 
century (1810-1893), an eminent worker in theory of numbers. 
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sum of the series and s n is its n-th partial sum. Then 



a n s s n 8 s n+l a n+l 

O n --- On+I ~ --- == - == -* 



Thus, the condition (19) is satisfied. 

Now, we shall prove the sufficiency of this condition. 
For this purpose let us assume that the inequality (19) 
holds. Then there exist an In > and an index Tc such 
that the inequality 

bn - b n+l > Ti 

<*<n+l 

holds for n^Jc. 
Thus we have 
h- 



h - a n < 6 n _! a n -i b n a n . 
Adding these inequalities we obtain 
n-Sk) < b k a k -b n a n <b k a kj whence s n < s k + 



. 

The last inequality proves that the series o 1 + a 2 + ... 
is bounded. Hence this series is convergent, since it is 
a bounded series with positive terms. 

As a corollary from Kummer theorem we [obtain 
the following 

KAABE CRITERION. A series a l + a 2 + ... with positive 
terms satisfying the condition 

(20) limn(- 1 }> 1 



n oo 



is convergent. 

Indeed, let us write bn = n. We have to prove that 
the condition (20) implies (19). Now, 



= limn( 1)-1>0, 

n-=oo 
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3.7. Absolutely convergent series 

A series a 1 + a a + ... is called absolutely convergent, if 



the series |ai| + |a 2 l+--- is convergent. A convergent series 
which is not absolutely convergent is called conditionally 
convergent. 

1. If a series a l + a 2 + ... is absolutely convergent, then 
it is convergent in the usual sense. 

Moreover, 

(21) 

According to the Cauchy theorem one has to estimate 
the expression a k + a k+l + ... + a n . Now, 



and the last sum tends to as & tends to oo, as a rest 
r/t-i of a convergent series (cf. 3.1). Hence for any e > 
there is a ft such that r&-i < ? whence \a k + a k+ i + ... + a n \ 
< e for any n > k. 

Thus, the convergence of the series a 1 + a 2 + ... is 
proved. At the same time, writing s n = a 1 + a 2 + ... + d n 
and t n = \a l +\a 2 \ + ... + \a n , we have \s n \ ^ t n , and in the 
limit we obtain |lims n = lim|s w | < limtf w , i.e. the for- 
mula (21). 

EXAMPLES. The geometric series a + aq + aq 2 + ..., where 
|g| < 1, is absolutely convergent because the series |a| + 
+ |a#l + ]fl(Z 2 | + ... is convergent (cf. 3.1). 

x n 
The series 2* ^ absolutely convergent for every oo 

(cf. 3.5, 1; as we shall show later, its sum is equal to e x ). 

The anharmonic series (7) is conditionally convergent, 
since the series of absolute values of its components is 
divergent (it is the harmonic series, cf. 3.2 above). 

Now, we shall consider the problem of the commu- 
tativity of infinite series. As it is well known a sum of 
a finite number of terms is commutative, i.e. does not 
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depend on the arrangement of the terms. We shall show 
that this property remains true also for absolutely con- 
vergent series; yet it does not hold for conditionally 
convergent series. However, this requires that we first 
establish what will be understood by a rearrangement 
of the terms, when the number of these terms is infinite 
(taking into account that some terms may be repeated 
arbitrarily often). 

By a permutation of the sequence of positive in- 
tegers we understand a sequence of positive integers 
m 1? m 2 ,... ? such that every positive integer appears in 
this sequence exactly once. If m 17 m 2 , ... is a permutation 
of the sequence of positive integers, then we say that 
the series a mi + a m2 + ... + a mn + ... is obtained from the 
series a 1 + a 2 + ... + a n + ... by a rearrangement of its com- 
ponents. 

2. Every absolutely convergent series is commutative. 

CO 

In other words, if a series ]? a n is absolutely con- 

w=l 

vergent and if m 1? m 2 , ... is a permutation of the sequence 
of positive integers, then 



- 
(22) .*.= 2 



**. 



Let e > 0. The series |o 1 [ + |a a | + ... being convergent, 
there exists a Tc such that 



(23) 



Since the sequence {m n } contains all positive integers, 
a number r exists such that the numbers 1,2,3,..., k 
all appear among the numbers m 1? m 2 , ..., m r . But each 
positive integer appears in the sequence {m n } only once; 
therefore we have m n > Jc for each n > r. So by a given 
n > r, if we cancel the numbers 1, 2, ..., Tc in the system 



70 I. SEQUENCES AND SERIES 

MX, w 2 , ..., m r , ..., m n , then there remain in this system 
only numbers > Jc (and different one from another). Thus, 
writing s n = a + a 2 + ... + a n and t n = a mi + a wa + ... + a^ 
and reducing in the difference t n s n the terms with 
equal indices, we obtain as remaining terms only terms 
with indices > ft. This (and the formula for the absolute 
value of a sum) implies 



|n *n|< 2j Kl> whence \t n s n \<e by (23). 

Since the last inequality holds for each n > r, we obtain 

lim t n = lim s n . 

This is equivalent to the formula (22). 

Eemark. The previous theorem cannot be extended 
to arbitrary convergent series. For example let us rear- 
range the terms of the series 1 -J + J J + ... in the 
following way: 

(24) 1-i- 



I n "1 i ~t ~* i 



where the numbers Jc lt fc 2 , ... are chosen in such a way that 



Then it is easily seen that the series (24) is divergent 

to oo. 

Writing c = 1 \ + J... (as known, c = log 2) one may 
easily prove that 

-^ + 1 +1-1+ 1 + ^-1 + ... 



Hence we see that by a rearrangement of terms we 
may obtain from the anharmonic series a divergent 
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series or a series convergent to another limit. The follow- 
ing general theorem (due to Eiemann ( l )) holds: given 
a conditionally convergent series, we may obtain a divergent 
series or a series convergent to a previously assigned number 
(finite or infinite) by a rearrangement of the terms of the 
given series. 

3.8. Multiplication of series 

oo 

(CAUCHY) THEOREM. Assuming the series a n and 

n l 

oo 

2 b n to be absolutely convergent, we have 

n-l 

oo 

(25) * 

n=l 

where 



(26) 



^ , 



(i.e. the sum of the indices of each term in the n-th 
line equals n+1). 

Let us write s n = a 1 + ... + a n , t n = fe 3 + ... +b n , and 

u n = C + .-. + Cn i.e. 



We have to estimate the difference 
(27) s n t n u n = a 1 



Since the series J b n and \a n \ are convergent and 



( l ) Bernhard Kiemann (1826-1866), famous for Ms works in the 
field of geometry, the theory of analytic functions and the theory of 
numbers. 
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consequently bounded, a number M exists such that 

(28) \ti\<M and |ai| + |a 2 | + - + KI < M 

for each j. 

At the same time, given e > 0, there exists a Tc such 
that the condition n > m > Jc implies (cf. 2.7, Be- 
mark (p)): 

(29) \t n -t m \<e and \a k+l \+\a k + z \ + ... + \a n \< e . 



In the following suppose that n > 2k. Then we have, 
by (27), 



\tn-t n -k\ + .-- 

Applying to the first bracket formula (29) and to the 
second one formula (28) we obtain (taking into account 
that n-fc+1 > fc and that \t n -tj\ ^ \t n \ + \tj'\ < 2M): 



where the second inequality is a consequence of the 
second parts of the formulae (28) and (29). 

So we have proved that the inequality \s n t n u n \ < 3 Me 
holds for each n > 2k. This means that liwi(s n t n u n ) = 0. 
Since the sequences {s n } and {t n } are convergent, we have 
lims n t n = lims w -limJ n , whence we obtain lim n -lim^ n = 
= lims n t n = limw n , i.e. the formula (25). 

EXAMPLE. We shall prove that 



^n^ y 

J n\ st-J 



n\ ^LJ n\ st-J n\ 

n-=0 n n-0 



Since both series are absolutely convergent, we may 
apply the formula (25). We obtain 



00 00 



no n=0 



y yn^ 

sLj nl~~ 
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?/ n ~ 2 



+ 

n=0 ' 



by the Newton binomial formula. 

Let us add that the above-proved formula follows 
also from the equality e x +y = e x -ev (cf. 3.7). 

Remarks. The theorem is also true under a weaker 
assumption; namely, both series have to be convergent and 
one of them (but not necessarily both) has to be absolutely 
convergent. Indeed, only the absolute convergence of the 

00 

series ]? a n was employed in our proof. 

n=l 

Yet if both series are conditionally convergent, then 

oo 

the series J c n may be divergent. This may be shown 

n=l 

on the following example: 



n n 

yn 

00 00 

the series a n and b n are convergent, but it is easily 



n=l 



seen that the series J c n is divergent. 

n=l 

Let us add (without proof) that if both series are 
conditionally convergent, then their product may be ob- 

oo 

tained by summation of the series c n by the method 

n=l 

of the "first means"; more exactly, the following theorem 
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(due to Ces&ro) holds: if the series a 1 + a 2 + ... and b l + b 2 + ... 
are convergent, then 

00 00 

tt-1 n-l 



... + c n . 

3.9*. Infinite products 

Just as we consider an infinite series to be a gener- 
alization of the idea of addition to an infinite number 
of terms, we may consider an infinite product as another 
infinite operation. Here we shall restrict ourselves to 
give the definition and several more important properties 
of infinite products. 

Let an infinite sequence of real numbers different 
from be given: a 1? a 2 ? > a ni Let us form the sequence 
of products: 
(30) p 1 = a 1 , p 2 = a^a 2 , ..., p n = <v <v n, ... 

If the sequence (30) is convergent, then we denote 
its limit by the symbol 



J7 a n = lim p n 



and we call it an infinite product. If this limit is finite 
and different from 0, then we say that the considered 
infinite product is convergent. 

We call the numbers a x , a 2 , ..., the factors of the in- 
finite product a^af... The terms of the sequence (30) 
are called the partial products. 

EXAMPLES, (a) The infinite product 



is convergent to 1. Indeed, 

2143 2n 
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Thus limpn = 1. 

n=oo 



/ 1\ 

(P) 7/ (l + -) = j i- e - the considered infinite product 

n-l \ W 

is divergent to oo, for 

2 3 ti+1 
p n = -.-.... n+1, whence limp n =oo. 

00 / 1\ 
(y) 77 (l ) = 0, i.e. the infinite product is diver- 



n-2 

gent to 0, for p n = - . 
w 

(8) The infinite product ( !) ( !) ... is divergent. 
Moreover, it is divergent neither to nor to oo. In this 
case the sequence of partial products oscillates, taking 
the values 1 and +1, alternately. 

1. CAUCHY CONDITION. A necessary and sufficient con- 
dition for the convergence of an infinite product <v <v 
(where a n ^ 0) is that to every e > a number Jc exists such 
that the inequality 

(31) \a k >a k+1 - ...-a n I\ <s 
holds for each n > fc. 

To prove the necessity of the Cauchy condition let us 
assume that the considered infinite product is convergent, 
i.e. that 

(32) \impm = p 7^0. 

m=oo 

Let c = \\p\. Then a number j exists such that 
\p m \ > c for m> j. 

Let a number e > be given. By (32), there exists 
a Jc such that \p n p*-i| < ce for n > Jc. One may also 
assume that Jc 1 > /, and so |p*-i| > c. Hence we obtain 



Pn 



ce 



i.e. the inequality (31). 
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In this way we have proved that the Cauchy con- 
dition is a necessary condition for the convergence of the 
infinite product under consideration. Now, we shall prove 
the sufficiency of this condition. 

Let us assume this condition to be satisfied. First of 
all we shall prove the sequence {p n } to be bounded. 
Substituting e = 1 in the Cauchy condition we conclude 
that a number r exists such that for n > r we have 

|a r +i a r + 2 - ... 0^ 1| < 1 , i.e. 

thus \p n -pr\ < \Pr\ 9 whence |pn|-|p r | < |Pn~Pr| < \Pr\ 

and finally \p n \ < 2|p r |. Hence we conclude that the 
sequence (30) is bounded. 

Now, let M be a number satisfying the condition 
M > |p w | for each positive integer n. According to (31), 
to any given number e > there exists a k such that 



(33) 



Pk-i 



for M > fc. Hence |p n P*-i| < e|p*-i| < eM. Thus, the 
sequence {p n } is convergent. It remains to prove that 
its limit is ^ 0. 

Now, supposing lim p n = 0, the formula (33) (with 

n oo 

a constant fc) should give the inequality 1 < e which 
contradicts the assumption that e is an arbitrary positive 
number. 

2. // the infinite product a^ag-... is convergent, then 
lim a n = 1 . 

n=oo 

Namely, let us assume that lim p n = p ^ 0. Then we 

n**oo 

have lim p n -i = p and dividing the first equality by the 

n*oo 

second one we obtain 



n-oo Pn-1 A1H1 p n -l 



=1. 
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Let us note that the equation lim a n 1 being (as we 

7l = OO 

have proved) a necessary condition of the convergence 

00 

of the product f] a n , is not a sufficient condition. The 

n-l 

examples (P) and (y) show this. 

Taking into account Theorem 2 it is suitable to 
write the factors of an infinite product in the form 
a n = l + 6 n . This makes possible a simple formulation 
of the dependence between the convergence of the product 

00 00 

f] (I + b n ) and the convergence of the series J b n . In 

n=l n~l 

fact, the following theorem holds: 

oo 

3. Assuming b n > for each n, the product f] (I + b n ) 

Til 

oo 

is convergent if and only if the series b n is convergent. 

71 = 1 

OO 

The same concerns the product /"/ (1 b n ) (assuming b n < 1). 

n=l 

A simple proof of this theorem may be obtained by 
application of the properties of the exponential function 
and especially of the inequality e x ^ 1 + a? which we shall 
prove in 8 (formula (16)). This inequality gives im- 
mediately 

p n < e* n , where p n = (1 + b^ - ... (1 -f b n ) , 



Since on the other hand we have, as easily seen, 
l + *n<pnj we conclude that the series {p n } and {s n } 
are either both bounded or both unbounded. Now, they 
are both increasing sequences; hence they are either both 
convergent or both divergent. Finally, the sequence {p n } 
cannot be convergent to 0, because p n > 1. 

Thus, the first part of our theorem is proved. 
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Before we proceed to the proof of the second part, 

oo 

let us note that if the product // (l + |w n |) is convergent, 



then the product f| (1 + ^n) is convergent, too. 

nl 

For let an e > be given and let & be chosen (ac- 
cording to Theorem 1) in such way that 

(l + \u k \)'(l + \u k + l \)-...-(l + \u n \)-Ke for n>Tc. 
Since, as is easily seen, 



so Theorem 1 implies the convergence of the product 

n 



n i 

oo 

Now, let us assume the series b n to be convergent. 

00 

By the first part of our theorem the product // (l + 6 n ) 

7ll 

is also convergent and thus, by the just proved remarks, 

oo 

the product f] (l b n ) is convergent, too. 

There remains to prove that the convergence of the 

oo 

product // (I b n ) implies the convergence of the series 

oo 

J b n . Let q n = (1 bj - ... (1 b n ) and let lim q n = q > 0. 

n 1 n=*oo 

Since q < q n < 6~ Sn , i.e. e Sn < - , the sequence {s n } is 
bounded and so it is convergent. 

00 

An infinite product // (I + u n ) is called absolutely con- 



71=1 

00 



vergent, when the product [] (l + \u n \) is convergent. As 

n 1 

we have just proved the absolute convergence implies 
convergence in the usual sense. One may also prove 
that just as in the case of the series the value of an 
absolutely convergent product does not depend on the ar- 
rangement of the factors. 
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Exercises on 3 

1. Prove the associativity law for convergent infinite 
series. Give an example of a divergent series a l + a 2 + a z + ... 
such that the series (a 1 + a 2 ) + (a 3 + a 4 ) + ... is convergent. 



2nl 
2. Prove that the series ]? ~ is convergent and the 



n 1 



series ]? - is divergent. 
Ti-i n 

3. Give an example of an alternating divergent series 
with the general term tending to 0. 

4. Give an example of a convergent series a 1 + a^ + ... 
with positive term for which lira -^ does not exist. 

n oo Q"n 

5. Prove that if a series a 1 + a a + ... with positive de- 
creasing terms is convergent, then lim na n = 0. 

n=oo 

00 -^ 

6. Prove that the series is convergent for s > 1 

n-l M 

and divergent for s < 1. 

Hint: apply the Eaabe criterion. 

7. Prove that if a series a l + a 2 + ... with positive 
terms is convergent, then the following two series are 
also convergent 



, k 

and 



8. Prove that the convergence of the series 
with positive decreasing terms implies the convergence of 



00 



the series 2 n a 2 n (Cauchy condensation theorem). 

n=l 

9. Assuming the formulae 

/> /Y*3 /Y>6 /Vt2 /Y*4 
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verify the formula sin (# + ?/) = sin#cost/ + sint/cos# ap- 
plying the theorem on multiplication of series. 
10. Calculate the infinite products 



oo 

11 



11. Examine the convergence of the product 



n ( 

n-O 



CHAPTER II 

FUNCTIONS 

4. FUNCTIONS AND THEIR LIMITS 

4.1. Definitions 

If to any real number x there corresponds a certain 
number y = /(a?), then we say that a function / is de- 
fined over the set of real numbers. 

For example by associating with any number x its 
square y = # 2 we have defined the function f(x) = aP. 
Similarly, the equation y = sina? defines a function over 
the set of real numbers. 

Not every function is defined over the whole set of 
real numbers; e.g. the equation y = I/a? defines a func- 
tion over the whole set of real numbers except the num- 
ber 0; because this equation does not associate any number 
with the number 0. Similarly, the function |/a? is defined 
only for x > ; the function tan x is defined for all real 
numbers different from odd multiples of the number TT. 

Generally, if to any x belonging to a certain set there 
corresponds a number y = /(a?), then a function is defined 
over this set. This set is called the set of arguments of 
the function. The numbers y of the form y = f(x) are 
called values of the function /; e.g. for the function |/#, 
the set of arguments equals the set of numbers > and 
so does the set of values of this function (by the way, 
let us add that the symbol \/~x does not define a func- 
tion, since it is not unique; by our definition, a function 
is always imique). 

We shall often speak about functions defined over an 
interval with ends a and b. Here we shall distinguish 

6 
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between the closed interval, i.e. interval together with 
ends that is the set of x satisfying the condition a < x < b 
and the open interval, i.e. interval without ends, that is 
the set of x such that a <x <b. 

Geometrically, we interpret a function / as the set 
of points on the plane ot the form (#, #), where y = f(x). 

This set is called the graph 
of the function / (or the 
geometric interpretation of 
the function /, or the curve 
y = /(#)); e.g. the graph 
of the function x 2 is, as 
well known, the parabola 
and the graph of the fun- 
ction l/#, the hyperbola 
(cf. Pig. 2). 

Projecting the graph of 
a function on the #-axis we 
FIG. 2 obtain the set of arguments 

of the function. Projecting 

it on the #-axis we obtain the set of values of the function. 
Among the sets lying on the plane, the graphs of func- 
tions are characterized by the property that no straight 
line parallel to the #-axis contains two points of the set. 
Let us add that by our definition a function having 
the set of all positive integers as the set of arguments 
is an infinite sequence. 

In all applications of mathematics, investigating re- 
lations between certain quantities, we are dealing with 
functions. E. g. the distance s covered by a body moving 
with a constant velocity v in a time t is given by the 
formula s = vt] similarly, the distance covered by a body 
falling under the gravitation field of the earth is a func- 
tion of time, namely s = %gt*. 

The variable x in the expression y = f(x) will be 
called also the independent variable, and y will be called 
the dependent variable. However, it has to be remembered 
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that the constant function y = c (we write also y = con- 
stant) will be also reckoned among functions; its graph 
is a straight line parallel to the #-axis (or identical to 
the #-axis). 

The functions about which we have spoken above are 
functions of one variable in distinction to functions of 
two and more variables. By a function of one variable, 
a number corresponds to any real number (belonging to 
the set of arguments), by a function of two variables, 
the value i(x,y) corresponds to the values of an ordered 
pair x,y. Similarly, by a function of three variables, 
a certain number /(#,;</,) corresponds to any triple of 
real numbers. 

4.2. Monotone functions 

If the condition x < x' implies f(x) < /(#'), then the 
function / is said to be strictly increasing. If in the last 
inequality the sign < will be replaced by <, then we 
are dealing with a function increasing in the wider sense 
(i. e. with a non-decreasing function). Similarly, if the 
condition x < x' implies f(x) > f(x') or f(x) > /(#')? then 
the function is said to be strictly decreasing or decreasing 
in the wider sense (non-increasing), respectively. 

Increasing and decreasing functions (in narrower or 
wider sense) are embraced by the general name monotone 
functions. 

EXAMPLES. The function x* is strictly increasing. The 
function x 2 is decreasing on the half-straight line x ^ 
and increasing on the half-straight line x ^ 0, on the 
whole ^Y-axis it is neither increasing nor decreasing. 

An example of a function increasing in the wider 
sense (but not strictly increasing) is the function [#]. By 
this symbol we indicate the integer n satisfying the 
inequality n ^ x (see Fig. 3). 

The function sin# is "piecewise monotone": it is in- 
creasing in the interval ^<#<^, decreasing in the 
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- 



#< etc. The functions cos x, tana; possess 



a similar j)roperty (as do most functions which we meet 
in practice). 

Let us note here that the above mentioned trigono- 
metric functions have an important property of periodi- 



FIG. 3 



city. A function f(x) is called periodic if a number c 
exists (called the period of the function) such that the 
equation f(x) = f(x + e) holds for every value x. The 
function sin has a period STT, the function tan has a period TC. 




FIG. 4 
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Remark. In general, a function f(x) will be called 
piece/wise monotone in the interval a < x < 6, if the interval 
a < x < & may be divided by means of a finite system of 
points 

fto < a i < a 2 < < #n ? where a- a and a n = b 

in intervals a a 1? a^? ? fln-i^n. in. such a way that the 
function /(;/) is defined and monotone inside of each of 
these intervals. 

For example the function defined by the conditions: 
/(a?) - x for < x < 1, /(I) - |, /(a?) = #-1 for 1 < x < 2, 
is piecewise monotone in the interval < x < 2. 

4.3. One-to-one functions. Inverse functions 

If the function / is strictly increasing, then the equa- 
tion y = j(x) determines x as a function of y, i. e. this 
equation may be solved with respect to x (treated as 
an unknown). Indeed, since to different x there cor- 
respond different y 9 so to any y belonging to the set of 
values of the function / there corresponds one and only 
one x such that /(#) = y\ hence x is a function of y. 
Thus, denoting this function by g we see that the equations 

(1) y=f(#) and x = g(y) 

are equivalent one to another. The function g is called 
inverse to j (sometimes we indicate it by the symbol /- 1 ). 

If we should assume the function / to be strictly de- 
creasing instead of assuming / to be strictly increasing, 
then we should find that / has an inverse function by 
the same arguments as above. For, the existence of the 
inverse function takes place always when the given func- 
tion is one-to-one, i.e. when the condition x ^ x' im- 
plies f(x) l~-f(x'). 

EXAMPLES. The function y = 2x + 3 has an inverse 
function, since solving this equation with respect to x 

T.. 2/~3 

we obtain x = ----- . 
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The function x 2 considered on the whole X-axis is not 
one-to-one because x 2 = (- x) 2 . However, if we restrict 
the set of arguments to the half-straight line x > 0, then 
the function x 2 is one-to-one in this set and its inverse 
function is \ f x. Similarly, restricting the arguments to 
the negative half -axis we should get \/x as the inverse 
function. Thus, although the function x 2 considered on 
the whole .X-axis does not possess an inversion, it may 
be spoken about various "branches" of the inversion of 
this function (after suitable restricting of the set of its 
arguments). 

Geometrically, a graph of a one-to-one function is 
characterized by the fact that on no straight line 
parallel to the J-axis does it contain two different points. 
According to the characterization of graphs of functions 
given in 4.1 it is the graph of the function x = g(y). 
To get from this function the function determined by 
the equation y = g(x), a rotation of the graph around 
the straight line y = x as the axis has to be performed. 

Let us note the easily proved formulae 



4.4. Elementary functions 

A function of the form ax + b, where a and b are 
constants, is called a linear function. The geometric graph 
of a linear function is a straight line. Conversely, any 
straight line, except straight lines parallel to the Y-axis, 
is a graph of a certain linear function. Depending on the 
sign of the coefficient a the function ax + b is increasing 
(for a > 0) or decreasing (for a < 0); if a = 0, then the 
function has a constant value b. Hence our function 

ni - n 

possesses an inverse x = - - , when a ^= 0. 

The next (in consideration of the simplicity) class of 
functions is the class of functions of the second degree: 
ax 2 + bx + c. Geometrically they represent parabolae (when 
a ^ 0). A more general class of functions represent the 
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polynomials, i.e. functions of the form a Q x n -{-a l x n ~~ l + ...+ 
+ a n -. l x + a n . A further generalization consists of the 

rational functions, i.e. functions of the form w, , 

where P(x) and Q(x) are polynomials. 

Polynomials are defined for all values of x. Eational 
functions are defined for all x except values for which 
the denominator vanishes, i. c. except the roots of the 
equation Q(x) 0. In the domain of rational functions 
the four arithmetical operations: addition, subtraction, 
multiplication and division are performable; in the domain 
of polynomials, the first three operations only. 

The function inverse to the power x n is the root \/x. 
If n is odd, then this function is defined for all x and 
if n is even, then it is defined only for x > 0. 

The roots are powers of the form x lln . More generally, 
we consider powers x" with an arbitrary real exponent for 
x > 0. This function is increasing if a > and decreasing 
if a < (for a = it is a constant) (cf. Fig. 2). 

Especially, the rational function - represents geo- 

x 

metrically a rectangular hyperbola. 

Treating the exponent in the power as a variable 
and the base as a constant, we get the exponential function 
a x ; we assume a > 0. The exponential function is in- 
creasing for a > 1 and decreasing for a < 1. 

The function inverse to the exponential function is 
the logarithm: the conditions y = log a x and x = a* are 
equivalent (for < a ^ 1). 

In particular, the function inverse to y = e?, where 

e liml 1 + J (cf. 2.10), is the natural logarithm x = logy 

(which we write without indicating the base). 

The logarithmic curves y = log a x are obtained by 
rotation of the exponential curves y = a x around the 
straight line y = x. 

Among the elementary functions we include also the 
trigonometric functions sin#, cos#, tana? and the functions 
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inverse to the trigonometric functions (i.e. cyclometric 
functions): arc sin a?, arc cos #, arc tan #. Since the trigo- 
nometric functions are not one-to-one, in the inversion 




FIG. 5 



of these functions Ave have to restrict the arguments to 
a suitable interval. We take |TT c5 x < |TU for sin#, 
< x < TT f or costf, JTT < x < |rc for tan#. In each of 



-1 



FIG. 6 

these intervals the functions considered are one-to-one 
and so reversible, respectively. It is clear that one could 
take other intervals for the argument; we should get 
other branches of the inverse functions. 
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Let us note that the set of arguments of the functions 
arc sin x and arc cos x is the interval 1 < x < 1 and the 
set of arguments of arc tan a? is the whole A'-axis. 

Remark. In elementary courses, the method of intro- 
duction of the power a x with a real irrational exponent 
is usually based implicitly on the existence of the limit 
lim a Tn , where {r n } is a monotone sequence of rational 

71 = 00 

numbers convergent to x (e.g. the sequence of decimal 
expansions of the number x). Now, the existence of this 
limit follows from the theorem on the convergence of 
monotone bounded sequences ( 2.6, Theorem 3) and 
from the theorem on the monotony of the function a r for 
rational r, known from the elementary algebra. 

The equation a x = lim cf n (a > 0) is considered as the 

w=oo 

definition of the power for irrational exponents. Here it 
makes no difference which sequence of rational numbers 
convergent to r will be denoted by {r n }, for lim r' n = lim r n 

7ln=OO /l=OO 

implies lim a rn ~ Tn = 1 (cf. 2.9, ()), whence 

n co 

lim af n lim a Tn - lim a 1 *" 1 * = lim a n . 

n=oo n oo n=oo w=oo 



The following formulae known for rational exponents 
from the elementary algebra hold also for arbitrary real 
exponents (when a > 0): 



(3) a x + v ^a x .a v , (abf = a x b x , (a x ) v ^ a xy . 

Writing x = lim r n , y lim s n and applying the above 

n=oo n=oo 

formulae to the rational exponents r n and $ n we perform 
the proof by passing to the limit. 

4.5. The limit of a function / at a point a 

The number g is called the limit of a function f at 
a point a, if for every sequence {# n } convergent to a with 
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terms different than a the equation lim/(# n ) = g holds; 

n=oo 

we denote this fact symbolically by 

=g. 



Thus, there exists the limit of the function / at 
a point a, if a common limit of all sequences /(#i), /(# 2 )> 
such that 

lim x n = a and x n = a for each n 

n*oo 

exists. 

For example lim x~ = 0, for if lim x n = 0, then 

XQ w-oo 

lim x^ = (lima? w ) a = 0. 

n=oo n~oo 

lim cos x = 1. Indeed, 1 cos # = 2 sin 2 J# and since 

xo 

by a known formula |sint| < 1 1\, we obtain |1 cosa?| < ia? 2 , 
whence lim (1 cos a?) = 0, i.e. lim cos a? = 1. 

a;=0 jc=o 

It is also easily proved that 
(4) lima^ l (a>0). 

X=Q 

If a function / is defined not for all real numbers, 
then we assume x n to belong to the arguments of this 
function; yet we do not assume this on a (assuming only 
that a is the limit of a certain sequence of arguments 

different than a): e.ff. the function - is not defined 

x 

for x = 0, however, there exists the limit of this function 
at the point 0, namely, 



/rx v 

(5) lim --- = 1 . 

x-o x 

Indeed, we have 

(6) sin# < x < tana? 

TT ^11 Tl V 

for - > x > and thus cos < - < 1 (the first of these 

j t27 

inequalities is obtained by multiplication of the second 
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inequality (6) by - ' and the seeond one is obtained 
x 

by division of the first from the inequaKties (6) by a?). 
Since lim cos x 1, so we easily conclude that lim x n 

aj=0 n*oo 

and x n >Q imply lim/(.r w ) = l (cf. 2, (17)). Finally, 

n=oo 

the assumption x > may be replaced by x < 0, because 

sin( x) 



x x 

The symbol lim j(x) will be used also to indicate the 

improper limit; e.g. Km oo. Yet Km- does not exist, 
since we have Km - oo for sequences {x n } tending to 
through positive values and Km -7- = oo for sequences 

n=oo &n 

with negative terms, respectively. 

However, in this case we can speak about a one-side 
limit at the point 0. Namely, a number g is called the 
right-side (or left-side) limit of a function / at the point , 
if the conditions lim x n -= a and x n > a (or x n < a) imply 

71=^00 

lim/(# n ) = </. The symbols . 

Km f(x) and lim f(x) 

xa+Q x=aQ 

(denoted also by /(a+0) and /(a 0)) indicate the right- 
and the left-side limit of the function / at the point a, 
respectively. 

Then we have lim - = oo, lim - = oo. Similarlv, 

_ /Y ' /> v ' 



Km logx = oo , lim taii# = oo , lim tana? = oo , 

^ + x^-0 X^ + 

(7) 

lim [x\ = n1 . 

x=*nQ 

However, there exist functions which do not even 
possess one-side limits (neither proper, nor improper), 
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Such is the function 

(8) f(x) 
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It has no one-side limit at the point 0. Indeed, sin 
has the value 1 at the points TT, ^7u + 27c, |7i + 47u, ..., 

... and so writing x n = 



, we have 



, 

I *xfv |~ .1 ) TC 

lim/(ff* n ) = 1 and lim# n = 0. At the same time, writing 



we have 



= 1 



\imx' n = 0. 



Thus, no right-side limit of the function / at the point 
exists; similarly, there exists no left-side limit at this 
point, too. 




FJG. 7 

Another example of a singular function constitutes 
the function assuming the value 1 at rational points 
and the value at irrational points (so-called Lejeune- 
Dirichlet ( l ) function). It does not possess either of the 
one-side limits at any point. 

Besides the limit of a function at a finite point a, 
the limit at infinity is considered, too. Namely, we denote 



(') Peter Lejeune-Dirichlet (1805-1859), a famous German ma- 
thematician. 
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by lim /(#) the common limit of the sequences f(x { ) , /(# 2 ) , ... 

a; oo 

such that lim x n oo (if such common limit exists). 

n*oo 

For example we have 

(9) lim - , lim ^=00 = lim logx , lim e x = . 

#=00 #J x oo aj=oo a;= oo 

The trigonometric functions sin, cos, tan do not possess 
any limit at 00. 

4.6. Operations on the limit 

Assuming the existence (and finiteiiess) of the limits 
lim f(x) and lim </(#), we obtain the formulae: 



(10) 
(11) 

ir==a sc= ic=a 

(12) lim[/(a?) flf(a>)] = lim/ (a?) limg(x) , 



x=a 



\\rnf (x) 
(13) \\ m i^l=j=H. when \img(x) ^ . 

' 



The above formulae remain true if a is replaced by oo 
or oo. They remain also true for one-side limits. 

These formulae are consequences of suitable formulae 
for infinite sequences ( 2, (6)-(9)). For example we shall 
prove the formula (13). 

Let lim/(#) = J., lim#(#) = JB ^ and let lim x n = , 

x=a xa xa 

where x n ^ a. Then we have lim f(x n ) = A 9 lim g(x n ) = B. 

n=oo n=oo 

Hence we conclude from the formula for the quotient 
of limits ( 2, (9)) that 



n 

lim-- = n "" eo ____ 
TC ^ooff(^n) " ' 

which implies formula (13). 
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Similarly we conclude from formulae (15) and (17) 
2 that, if the limits limf(x) and ttmg(x) exist, then 

xa ce=a 

(14) the inequality f(oo)^g(x) implies limf(x) < \img(x) , 

x*=a x*=a 

(15) the inequality f(x) < h(x) < g(x) together with li 

x^ 

imply limh(x) ^lim/(#) limg(x). 



Here the formulae are valid for a = 00 and for 
one-side limits. 

The following formula on the composition of func- 
tions holds: 

(16) If lim/(#) = A and limg(y) = B ,ihen lim #[/(#)] = J5, 

xa y=*A x=n 

if the function / does not assume the value A in a neigh- 
bourhood of the point a (i.e. in a certain open interval 
containing a). 

This formula remains true also for infinite values 
A , B and for one-side limits, after accepting to write 
(#) = A + 0, if lim/(#) = A and if f(x) > A in a neigh- 



bourhood of a (an analogous convention regards the symbol 
A and the one-side limit). 

Namely, let lim x n = a and x n ^ a. Then we have 

n=oo 

lim /(# n ) == A. Let us write yn^K^n)- Since the func- 

w=oo 

tion / does not assume the value A in a certain interval 
containing the point a inside, so we have, for sufficiently 
large n, f(x n ) ^ J., i.e. y n ^ A. Thus lim g(y n ) == 5, i.e. 

n-=oo 

lim g[f(x n )'] = J5. Hence we conclude that limg[f(x)'] = JS. 

71=00 aj a 

In particular we have the following formula which 
enables us to reduce the calculation of limits at oo to 
calculation of limits at finite points: 

(17) If lim /(-) exists, linen limf(t) = lim /(-) . 

X** + Q \/ t=oo x--fO \^/ 
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Indeed, substituting # = 7 we have lim-= +0, 

t t~<x> t 

whence we get the formula (17) according to the previous 
one (writing a = oo and A = +0). 

As is easily seen, the reverse relation also holds: 



(18) If Mmf(t) exists, then lim /(-) = li 

f=oo o:+0 \#7 <= 

EXAMPLES, (a) The following formula has an im- 
portant application in the differential calculus: 



(19) lim (! + #)* -= e. 

To deduce this formula we shall consider two follow- 
ing cases: 

1) x > 0. Let us write y = - . One has to prove that 

oo 

(20) lim (l + ~ j - e 

according to the formula (18). Now, let lim t/ n = oo and 

let us write k n = [-y w ], i.e. that fc n is a positive integer 
satisfying the double-inequality 

Hence 

-j~-\ < < F- ( for 2/n > 1) 
and thus 



i.e. 
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Since lim y n = oo and Tc n > y n 1, we have lini fc 7l = oo 

n=oo 71=00 

/ l\ n 

and since lim 1 + - ) = e, we conclude (cf. 2, Exercise 5) 

n=oo \ M/ 



1 \* 

that limll + T-J = e. Finally, since 

n=oo \ nl 



lim ^y- = 1 = lim (l -h \ , 

lim 1 1 + )"" = 

\ 17 I 

7? =OO \ if '/I/ 



P obtain 



according to the formula of the double-inequality 
(cf. 2, (17)). 

So the formula (20) and thus the formula (10), too, 
are proved for x > 0. 

2) Let x < 0. Writing y = -, we have 

CO 

I _?. 1 

lim (l + #) r lim (1 a?) J ' 

#-- rc = +oo 



1\^' 

_i 
y] 

Hence it remains to prove that 

(22) lim (l- if = -. 

i/^ooV y] e 

Let limy n ~ oo. The formula (21) gives 



y y n 



However, lim(l--) n =i (cf. 2.10, (26)); hence 

n-=oo \ W/ 

reasoning as before we obtain lim (l -- 1 = -. Thus the 

n=oo \ yn] e 



formula (22) is proved. 
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C x 

(P) lim = oo, i.e. the function e x increases more 

rapidly than x. 

Namely, let lim x n = oo and let fc n [x n ] as before. 

Thus, 

Since ( 3.5, 7) lim = oo and lim k n = oo, so lim -=r- = oo 

n=oo % w=oo n-oo n 

and thus lim = oo. Whence the required formula follows. 

(Y) lim = = oo . 

3.^00 LOgX 

Since x = e l KX and lim logo? = oo, so substituting y = logx 
we obtain (cf. (16)): 

lim = = lim = = lim =00. 

x=oo log x x= ,<x> log x y= ,oo y 

(8) lim (xlogx) . 

For 

1 

lim (xlogx) = lim = lim ~^- = . 

4.7. Conditions for the existence of the limit 

The following theorem corresponds to the theorem 
on the convergence of monotone bounded sequences: 

THEOREM 1. If a function f is increasing fin the wider 
sense) and bounded above, then lim f(x) exists at every 

point a. 

An analogous theorem holds for decreasing functions. 

By a function bounded above (or below) we understand 
a function, the set of values of which is bounded above 
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(below), i.e. a function / such that a number M exists 
for which the inequality M > /(#) (or M </(#)) holds 
for every x. 

The proof of Theorem 1. The sequence la j 

being increasing, the sequence {/(a )| is increasing, too. 
But since the last sequence is also bounded, hence it is 
convergent. Let lim /(a ) = g. It remains for us to 

,=oo \ '#/ 

prove that the conditions lim x }l a and x a < a imply 

n=*oo 

the equation 



Let an e > be given. Then there is an m such that 
la I < s. To this m we choose a number fc such 



that the inequality n>lc implies a < x tl . Hence 

(x n ), whence 



Moreover, to each n there exists an > such that 
x n < a . Hence 



Hence we conclude that lim/(# w ) = g. 

noo 

Eemark. Theorem 1 may be generalized to the case 
of unbounded monotone functions just as to the case 
a = 00. It may be written also in the following, slightly 
more general, form: 

If a junction f is monotone (in the wider sense) and 
bounded, then the limits lim f(x) exist at every point a. 
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The proof is completely analogous. 
THEOREM 2. // a junction f has no (finite) limit at 
a point a, then a sequence {x n } exists such that lim x n = a, 

n~oo 

x n ^ a and that the sequence {f(x n )} is divergent. 

For, let us suppose the sequence {f(x n )} to be con- 
vergent for every such sequence {x tl }. Since the function / 
has no limit at the point a, so two sequences {x n } and 
{x' n } must exist satisfying our conditions and such 
that lim / (x n ) = lim /(#,'). Let us consider the sequence 

tt=OO ?l = OO 

.%, j?j, # 2 , x*, ..., M n9 X'H, ... This sequence is convergent to a 
and all its terms are = a, but the sequence /(.J^), /(#0, 
/(,/; 2 ), /(j?2), is divergent. 

The following theorem includes the so-called Cauchy 
definition of the limit of a function at a point: 

THEOREM 3. A necessary and sufficient condition for 
the equation lim f(x) = g to be valid is that to every e > 

x=*a 

a number d > exists such that the inequality < \x a\ < d 
implies \ f (x) g \ < e. 

First, let us suppose that the Cauchy condition is not 
satisfied, i.e. that there exists an e > such that to any 
d > an x exists for which < |.r a] < #, but | f(x) g\ 

> e. Especially, substituting d - we conclude that 

it' 

there exists a sequence {x n } for which 

(23) 0<|ar w -a|<i 
and 

(24) \1(*n)-g\>B. 

It follows from (23) that lim x tl = a and x tl = a^ Hence, 

71=^00 

supposing lim/(#) == g we should have lim/(^) = g. But 

xa uoo 

the last formula is contradictory to the inequality (24). 

Thus we have proved the Cauchy condition to be 

a necessary condition for the validity of the equation 
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lim/(#) = g. We shall now prove this condition to be 

x=a 

a sufficient one. 

Let an e > be given and let lim x n = a and x n = a. 

noo 

Then by the Canchy condition, a number <5 > exists 
such that the inequality Q <\x n a\< d implies \i(x n )-g\ 
< s. But in consideration of the equation lim x n = a, the 

n-=oo 

inequality \x n a\<d holds for all n beginning with 
a certain &. For the same n we have the inequality 
l/(#n) 9\< e > This means that lim f(x n ) = g. Hence we 

n~oo 

conclude that lim/(#) = </. 



The following theorem corresponds to the Cauchy 
theorem in the theory of sequences ( 2.7): 

THEOREM 4. A necessary and sufficient condition for 
the existence of the (finite) limit of a function f at a point a 
is that to any E > a number d > exists such that the 
conditions 

(25) 0<|o? a\<d and Q<\x' a <d 

imply \f(x) f(x')\ < e. 

Indeed, our condition is necessary, for if limf(x) = #, 

#=a 

then to any given e > there is a d > such that the 
condition < \x~ a\ < d implies \f(x) g\< $e. Hence, if 
the conditions (25) are satisfied, then the inequalities 
l/(#) ffI < l ai id | /(#') g\ < ie hold. Adding both these 
inequalities we obtain \f(x) f(x')\<e. 

The condition is sufficient. Indeed, let us suppose 
that the limit of the function / at the point a does not 
exist. Then there exists by Theorem 2 a sequence {x n } 
such that lim x n = a, x n ^ a. Suppose the condition for- 

n=oo 

mulated in the theorem is satisfied. Since the equation 
lim x n = a implies the existence of a fc such that for 

noo 

n^lc, x = x n and x' = x k may be substituted in the 
inequalities (25), so we have \f(x n ) f(x k )\ < s. By the 
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Cauchy theorem on sequences, we conclude the conver- 
gence of the sequence {/(# n )}> in contradiction to our 
assumption. 

B> em ark. For a = oo Theorems 3 and 4: may be 
formulated as follows: 

THEOREM 3'. A necessary and sufficient condition for 
the equation \imf(x) = g is that to any s > a number r 

x=oo 

exists such that the inequality x> r implies \f(x) g\<e. 

THEOREM 4'. A necessary and sufficient condition for 
the existence of the (finite) limit lim/(,#) is that to any 

91 = 00 

e > a number r exists such that the conditions x> r 
and x' > r imply \f(x) f(x')\<e. 

The proofs of these theorems are completely analogous 
to the proofs of Theorems 3 and 4. 

Exercises on 4 

1. Sketch the graphs of the functions 

x r _ .1 ,.11.1 

---- - , x\x\, x sin - , & sm - , - sin - 

jj+1 #' x 1 x x 

and calculate the limits of these functions at the point 0. 

2. Find the limits of a polynomial at oo, i. e. 
lim (x n + a n -ix n - 1 + ... + a l x + a ) (consider the case of n 

x=oo 

even and the case of n odd, seperately). 

3. Evaluate: 

miax .. 3 
lim - , lim 



- . 

* 

4. Let a bounded function f(x) be given in the interval 
a < x <; b. Let us divide this interval into a finite number 
of intervals by means of the points a Q < a l < ... < a n 
(where a Q ~ a, a n == b) and let us consider the sum 
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If the set of the numbers s corresponding to all possible 
partitions of the interval ab is bounded, then the func- 
tion / is said to be of bounded variation. 

Prove that the sum of two functions of bounded 
variation is a function of bounded variation; a monotone 
function is of bounded variation. 

5. Prove that if a function / bounded in each finite 
interval satisfies the condition lim [/(#4-l) /(#)] = |7> 

,'C = OO 

then lim ^ = g. 

x-^oo <V 

6. Prove that the formula /(#) lim lim (cosw ! .7r#) 2fc 

n=oo k=-(x> 

represents the Dirichlet function considered in 4.5. 

7. A function f(x) is called an even function, if the 
condition f(x) = /(-#) holds for every x. Analogously, 
if the condition f(x) = f(x) is satisfied, then the 
function / is called an odd junction. 

Give examples of even functions and odd functions, 
among the trigonometric functions. 

Characterize even and odd functions by means of 
geometrical conditions. 

8. Prove that every function is a sum of an even 
function and an odd function. 

(Note that the function g(x) /(#)+/(#) is even.) 



5. CONTINUOUS FUNCTIONS 

5.1. Definition 

A function / is said to be continuous at a point a, if 
the condition 
(1) /(a)=lim/(aO 

x=a 

is satisfied. 

According to the definition of the symbol l\mf(x) 

x=a 

this means that the equation lim x n = a implies the 
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equation \imf(x n ) = /(a). (Obviously, assumption x n ^ a 

n=oo 

may be omitted here.) 

Thus, if a function / is continuous at a point a, then 

(2) / ( Jim x n ) = lim / (x n ) , whenever lim x n = a . 

n=oo n=oo ?i=oo 

If in the equation (1) we replace the limit by a one-side 
limit, we obtain the definition of the one-side continuity. 
Namely, a function / is right-side continuous (or left-side 
continuous) at a point a, if 

/(a) = lim J(x) (or f(a) - lim /(*)) . 

x=a+0 x=a 

If a function / is defined not for all a?, then we restrict x 
obviously to the set of arguments of the function /(#); 
e.g. if the set of arguments of a function / is the closed 
interval a < x < fc, then the continuity of the function / 
at the point a means the same as its right-side continuity. 

A function continuous at every value of the argument 
is called briefly a continuous function. Tn particular, 
a continuous function defined in the interval a < x < b 
is a function continuous at every point inside this interval, 
right-side continuous at a and left-side continuous at b. 

A function / will be said also to be piecewise con- 
tinuous in the interval a < x < 6, if this interval may 
be divided by means of a finite system of points a Q < a { 
< a 2 <...<%, where a Q = a and a n &, into intervals 
flfc-i#fc> & = l,2,...,win such a way that the function / 
is continuous inside of each of these intervals and that 
the limits lim f(x) and lim f(x) exist; i.e. if for each Jc 

a=-a fc _ 1 +0 a;=a fc 

the function f k (x) defined by the conditions f k (x) = f(x) 
for a k .. l <x<a k and / fc (a*_i) - /(a^ + 0), j k (a k ) = /(a A .-0), 
is continuous in the interval a k -i < x < a k . 

Thus, a function having a finite number of points of 
discontinuity in which both the one-side limits exist is 
piecewise continuous. 
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EXAMPLES. As we have proved in 4.5, lima?' 2 = 0. 

rr-O 

This means that the function x* is continuous at the 
point (though it is easily seen that it is a function con- 
tinuous at every point). Similarly, the equation Jim cos .T 

3=0 

= 1 = cosO implies the continuity of the function cos x 
at the point 0. 

The function [a?] is discontinuous at integer points; 
speaking more precisely: it is right-side continuous, but 
not left-side continuous at these points. 

The function sin- is discontinuous at the point 

CO 

independently of the value that could be given to this 
function at this point; for its limit at the point does 
not exist. The Dirichlet function (cf . 4.5) is discontinuous 
at every point. 

The notion of continuity may be extended also to the 
points at the infinity, understanding by a function con- 
tinuous at oo a function / such that the limit limf(x) 

ar^=oo 

exists. 

5.2. Cauchy characterization of continuity. Geometrical 
interpretation 

The following theorem may be considered as the de- 
finition of continuity (the "Cauchy definition" in dis- 
tinction to the "Heine definition" which we have intro- 
duced in o.l). It follows directly from 4.7, Theorem 3. 

A necessary and sufficient condition for a function f 
to be continuous at a point a is that for any e > there 
exists a number 6> such that the inequality \xa\ < 6 
implies \f(x) f(a)\<s. 

Speaking more figuratively, this means that to suf- 
ficiently small increments of the independent variable 
there correspond arbitrarily small increments of the de- 
pendent variable. This may be written as follows: 

(3) the condition \h\<d implies \f(a + h) f(a)\<e. 
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Geometrically, the continuity of a function / at a point a 
means as follows: let P denote a strip parallel to the 
A'-axis and containing the straight line y /(a) inside; 
then there exists a strip Q parallel to the Y-axis and 
containing the straight line x = a inside, such that the 
part of the curve given by the equation y = f(x) included 
in the strip Q, is also included in the strip P. 



f(a) 



a 



FIG. 8 



We may pass from the analytic definition based on 
the Cauchy condition to the above geometrical definition 
immediately, assuming the strip P to be defined by the 
straight lines y = f(a)e and .the strip Q to be defined 
by the straight lines x = a 6. 

It is easily seen from the above definitions that the 
continuity of a function / at a point a is a local property 
in the sense that it depends on the behaviour of the 
function in the neighbourhood of the point a. In order 
to find whether a function / is continuous at a point a 
it suffices to know this function in an arbitrarily small 
interval containing the point a inside. 

5.3. Continuity of elementary functions 

It follows immediately from the formulae on the 
operations on limits of functions ( 4, (10)-(13)) that the 
arithmetical operations on continuous junctions give con- 
tinuous junctions, again. Speaking more exactly, if the 
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functions f and g are continuous at a point a, then the sum, 
the difference, the product and the quotient (when g(a) ^ 0) 
of these functions are continuous at the point a, also. 
For example assuming lim/(#) /(a) and Mmg(x) = 

x^a x=a 

= g(a) we have 

lira [/(a?) -0(3?)] = limf(x)'limg(x) =/() (a) 

x--a x^a a?=a 

which means that the function f(x)-g(x) is continuous 
at the point a. 

Hence it follows that a polynomial is a continuous 
junction. 

Namely, the constant function f(x) = const, and the 
function j(x) = x (the identity) are continuous functions, 
as easily seen. 

More generally, any rational function, i.e. function of 

P(x) 
the form f(x)=^~ ( ~, where P(x) and Q(x) are poly- 



nomials, is a continuous function (obviously at such points 
at which it is defined, i.e. everywhere except of the roots 
of the denominator). 

Before proceeding to the proof of the continuity of 
other elementary functions, let us note that according to 
the formula (1), the continuity of a function / at a point x 
means that ]\mf(x + h) = f(x), i.e. that 



(4) 

/j-O 

We shall prove now that the exponential function 
a x (a > 0) is continuous. 

Indeed, we have a x+h a x = a x (a h 1) and lima 7 * = 1 

fc=0 

(cf. 4, (4)). Hence lim(a x + h a x ) = and this means 

ft=0 

according to the formula (4) that the function a x is 
continuous. 

The trigonometric functions sin and cos are continuous. 

Indeed, 

sin (x + h) sin x = 2 sin-- cos lx+ ~\ 
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and since sin/| < \t\ and |cos| < 1, we have 

|sin(# + A) sin#| <|A|, whence lim[sin(# + A) sina?| 0, 

h^o 

i.e. 



liin sin ( j? 



Similarly, 



I cos (# + A) -- cos 'X\ ^2 



. h 
sin ;, 



= . 



sin 1 



whence 



lim cos (x + h ) cos a? = . 



Since tana? = ----- , the function tana? is a continuous 
co so? 

function as a quotient of continuous functions. The 
functions 



1. 



cosj? 



cos a? 



are also continuous functions (at every x at which they 
are defined). 

Among the elementary functions there remain still 
to consider the functions inverse to the above considered, 
namely, the logarithm and the cyclometric functions. 
However, we shall not prove the continuity of these 
functions now, because it follows from a general theorem 
on the continuity of functions inverse to continuous 
functions which will be proved something later. 

However, we shall prove now that the composition' 
of continuous functions is a continuous function. Speaking 
more exactly, if two functions y = f(x) and z = g(y) are 
given and if the function f is continuous at a point a and 
if the function g is continuous at the point /(&), then the 
junction g(f(x)} is continuous at the point a. 

For, let lim x n a. Hence lim/(# n ) = f(a). Writing 

n oo n oo 

b = f(a) and y n 1(n)j we have then lim y n = 6, whence 
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the continuity of the function g implies 

lim g(y n ) = g(b) , i.e. lim g(f(x n )) - g(j(a)) . 

71 = 00 M = 00 

But this means the continuity of the composite function 
g(f(x)} at the point a. 

Hence it follows that taking the elementary functions 
considered in 4.4 as the starting-point and applying to 
these functions the arithmetical operations and the com- 
position, we yet remain in the domain of continuous 
functions. 

For example the function # + tan(j? 2 ) is a continuous 

function. Similarly, the function sin - is a continuous 

x 

function in the set of its arguments, i.e. for x ^ 0. But 
the function / defined by the conditions: 

(5) f(x) - sin - for x = and /(O) = 

oo 

is discontinuous at the point 0. As we know, the limit 
of the function / at the point does not exist at all 
(cf. 4.5, (8)). 

Hence it follows also that the function defined by the 
conditions (5) cannot be written by means of continuous 
functions only. Similarly, the function defined as follows: 

/(#) = ! for tf^O and /(O) = 

is discontinuous at the point 0. However, the last function 
may be written by means of a limit. Kamely, 

.. xt nx 

f(x) = lim 3r = lim IT - . 

*=oo 1 + Xt n-col+nX 

Ee m ark. The following formulation of the theorem 
on the composition of functions a little more general 
than the above is convenient in applications: if lim f(x) 

#=ao 

exists and if g is continuous at this point, then 



(6) lim flf[/(a?)]=flf[lim /Or)] . 

x=a bo x=a0 
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The proof remains almost without change. 
EXAMPLE, lim s? = 1, for 

ar=+0 

lim (xlogx) 

lim x* = lim e xlQ % x 0*-+ = 6 = 1 . 



Here /(a?) = xlogx, y(x) e x . The function / is not de- 
fined at the point 0; however, it has a right-side limit 
(= 0; cf. 4.6, (8)) at this point. 

5.4. General properties of continuous functions 

1. THEOREM ON THE UNIFORM CONTINUITY. // a func- 
tion f is continuous in a closed interval a < x < fe, then to 
every e > there exists a d > such that the inequality 
\x x' <d implies \f(x) f(x')\<e. 

Before proceeding to the proof, let us note that the 
number d mentioned in the above theorem does not 
depend on x in distinction to the case of the definition 
of a function continuous at every point x (belonging 
to the considered set of arguments), where such de- 
pendence holds. This independence of the number A of 
the variable x we emphasize saying "uniform" con- 
tinuity. 

The proof of the theorem will be given by reductio 
ad absurdum. Let us suppose that a number e > exists 
such that, given any d > 0, there exists a pair of arguments 
x and x' such that \xx'\<& and \f(x) f(x')\^e. Then 

in particular, writing 6 = - we conclude that two se- 
quences {x n } and {x' n } exist satisfying the following in- 
equalities: 

t r 7\ n '*"" /y '""' h /i *^* 'f* 1 -""" / I /y //' I *** 

(t) a ^ x n ^ o j a ^, x n . ^ . i x n x n \ < ~ 

IV 

The sequence {x n } being bounded, it contains according 
to the Bolzano-Weierstrass theorem ( 2.6, 2) a convergent 
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subsequence. Let us write lim x nln = c. It follows from 

n-^oo 

the first of the inequalities (7) that a < c < b. Hence the 
function / is continuous at the point c and so lim/(# m j 

n<x> 

= f(c). But the third of the inequalities (7) implies also 
lim x' mn c, because lim x' nin = lim x mn . The continuity of 



the function / gives lim i(x' m , n ) f(c) as before. Thus 

n=-oo 

lim \j(x mn )~ /(#4J] ' = 0. But the last equation is 0011- 

n=oo 

tradictoiy to the last of the inequalities (7). 
Hence, the theorem is proved. 
Remark. The assumption that the considered interval 

is closed is essential: e.g. the function - is continuous 
7 x 

at any point of the open interval < x < 1 but it is not 
uniformly continuous in this interval. 

2. WEIERSTKASS THEOREM. A function f continuous in 
a closed interval a < x < b is bounded and attains its upper 
and lower bounds M and m, i.e. there exist in this interval 
two points c and d such that f(c) = M and f(d) = m. 

First of all we shall prove the boundedness of the 
function /, i.e. that a number A exists such that the 
inequality A > \f(x)\ holds for any x belonging to the 
interval ab. Now, by substitution s 1, Theorem 1 
implies the existence of a d > such that if two points x 
and x f belong to an interval (contained in the interval ab) 
of the length < d, then \f(x) j(x')\<l. Let us choose 

a number n in such way that -- < (3; dividing the 

interval ab in n equal intervals, the length of everyone 
of them will be less than d. Thus, denoting the ends of 
these intervals by a , a 1? ..., a n (a = a, a n = ft), suc- 
cessively, we have 

\f(x)~f(a l )\<l for a <,-<%, 

whence |/(a?)| < 1 + |/(0i)l, 
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and in general: 

| / (x) f (a k ) | < 1 for a*-! < x < a k , 
whence 



Thus, denoting by A the greatest of the numbers 
1-f | /(a fr )|, where Jc assumes the values l,2,...,w, we 
have \f(x)\< A for every x belonging to the interval ab. 

So we have proved that the function / is bounded, 
i.e. that the set of values of this function is bounded. 
Hence, the upper bound M and the lower bound m of 
this set exist (cf. 1.7). We shall prove by reductio ad 
absurdum that M is one of the values of the function / 
(the proof for m is completely analogous). 

Let us suppose that it is not true, i. e. that we have 

M f(x) ^ for any x. Then the function g(x) ~ f , 





is defined for any x in the interval a < x < b and is con- 
tinuous in this interval. Hence it is a bounded function, 
as we have just proved. Then a number N exists such 

that g(x) < N, i.e. M f(x) > ^, that is j(x) < M ^. 

But the last inequality proves tHe existence of a number 
less than M which is greater than all numbers /(#), 
where x takes values from the interval a < x < b. But 
this is contradictory to the assumption that M is the 
upper bound of the function / in this interval. 

Thus, supposing the theorem to be wrong we have 
got a contradiction. 

3. DABBOUX ( l ) PROPERTY. A junction continuous in 
a closed interval a -^ x < b assumes all values between any 
two values of this function. This means that, if y is a number 
between f(a) and f(b) (i.e. either f(a) < y < f(b) or f(b) 
< y < f( a ))i then there exists a c in the interval ab such 
that f(c) = y. 



Gaston Darboux (1842-1917), a famous French geometer. 
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Let us assume that f(a) <y < f(b) (in the case of the 
other eventuality, the arguments are completely similar). 
Supposing the theorem to be false, i.e. supposing y~f(x) 
^ for any x belonging to the interval a&, the function 

h(x) | "77-77 would be bounded by Theorem 2. 

Let M > h(x), i.e. let 

1 

Substituting e = - -^ in Theorem 1 we conclude that 

a number 6 > exists such that if two points x and x 
belong to an interval of the length < d, then 



_ 

Let n indicate a positive integer such that - < 6, 

n 

Dividing the segment ab into n equal segments and de- 
noting by a , a 1? ..., a n the successive ends of these seg- 
ments, as in the proof of the previous theorem, we con- 
clude that 

(0) |/(a*)-/(a*-i)| < ~ for 1c - 1, 2, ...,n . 

Since /(a ) < y < /(a n ), so there exists among the num- 
bers 1,2,...,^ the least number m satisfying the con- 
dition y < f(a m ). We have m > and f(a m - l ) < y < f(a m ), 
whence 

< y ffan-l) < 1(<lm) /Kn-l) < r 



by (9), but this contradicts the inequality (8). 

Theorems 2 and 3 lead to the following conclusion: 

4. A function continuous in a closed interval a < x < b 
assumes all values between its lower bound m and upper 
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bound M, including the bounds, fn other words, the set of 
values of the function is the closed interval m < y < M. 

Be mark 8. (a) The property of continuous functions 
expressed in Theorem 3 (the so-called Darboux property) 
is especially intuitive in its geometrical interpretation. 
However, this property does not characterize continuous 
functions, e.g. the function (5) possesses this property 
although it is not continuous. 

(p) Theorem 3 implies immediately the existence of 
j/# for any real #, if n is odd and for any x > 0, if n 
is even. Indeed, if n is odd, then lim x n = oo and 

x= oo 

lim x n = oo and so the function x n assumes all real values. 

ic=oo 

Thus the function inverse with regard to #'", i.e. f x is 
defined for every real x. Similarly, if n is even, then the 
function x n , x > 0, assumes all values from to oo; 
hence n \' x is defined for all these values. 

Analogously, it follows from the formulae lim e x = 

#= 00 

and lim ^ = 00 that the function e* assumes all positive 

tf=rOO 

values; hence \ogx is defined for any positive x. Finally, 
arc tan # is defined for every real x. 

Let us add that the formula'e 4. 4, (3) imply imme- 
diately the following formulae connecting logarithms, for 
positive a, x and y (a ^ 1): 

(10) log a xy - \og a x+ log a y , Iog (d^) - y\og a x , 

(11) a' = 0* 10 *", log a ,7? - |^ . 

For example to prove the first of the formulae (10), 
let us substitute log a ,T = t, \og a y = z, i.e. x = a 1 , y = a z . 
By 4.4, (3) we get 
xy = a t - a z = a l + z , whence Iog #// = t + z = log a x + log a y. 

The second of the formulae (11) is obtained from the 
second of the formulae (10): 

log a' = tloga , i.e. logo? = log a # loga . 
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5.5. Continuity of inverse functions 

In 4.3 we have seen that a one-to-one function 
y = -f(x) defines an inverse function x = <j(y)> Now, we 
shall prove that a junction inverse with regard to a con- 
tinuous function is also continuous. Speaking more exactly: 

1. // a junction y = f(x) is one-to-one and continuous 
in an interval a < x < ft, then the inverse function x = (j(y) 
is continuous in the interval m C y < M, where m and M 
are the lower bound, and the upper bound of the function /, 
respectively. 

Let m C c ^ M. By Theorem 4 of 5.4, the function g 
is defined at the point c. Let c lim y n , where y H belongs 

M^OO 

to the interval mM 9 i.e. y n is of the form y n == f(x n ). 
It has to be proved that limg(y n ) = g(c). 

/<,~oo 

Let c f(d). Thus we have to prove that the con- 
dition lim /(.r n ) = f(d) inri])lies lim x n = d (because g(y n ) 

)1 <X> fl-^OO 

$n, 0(c) ^ ^0- Since the sequence {x n } is bounded, 
being contained in the interval afe, so the last inequality 
will be proved, if we show that every convergent sub- 
sequence of the sequence {x n } is convergent to the limit d 
(cf . 2.6, Theorem 4). Thus, let lim x kn - d'. We shall 

w=oo 

prove that d f d. The continuity of the function / 
implies Yimf(x kn ) = f(d') and since lim/(^ n ) ^ limf(x n ) 

n~oo n oo n<x> 

= f(d), we get f(d') = f(d). The function / is one-to-one, 
hence we conclude that iV = d. 

Thus, the theorem is proved. 

APPLICATIONS, (a) log a # is a continuous junction 
(1 = a > 0), for it is inverse to the continuous function a x . 

(p) The cydometric junctions arcsiii^, arc cos a?, 
arc tana? etc. are continuous as inverse functions with 
regard to the trigonometric functions (which are con- 
tinuous). 
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(y) Let {a n } be a sequence with positive terms. Then 

00 

the convergence of the infinite product // a n implies the 



convergence of the infinite series ^ log a,,. Moreover, there 
holds the relation 

oo oo <x> 

?=-! / = ! /< = ! 

oo 

Similarly, assuming the convergence of the series V logfl,,,, 

00 

the product // a n is convergent, too, and the relation (12) 
takes also place. 

Let p n = a l 2 * ' a n- The 1 - assumption of convergence 
of the sequence {/;,} and the continuity of the logarithm 
imply (cf. (2)): 



and 

lim log/> n = liin log(a! - ... - a tl ) = lim [log^ + ... + loga /t ] 



00 

VI 



Similarly, writing s tl loga^... + loga n and assuming 
the convergence of the sequence {,<?}, we have by the 
continuity of the exponential function: 

lim s tt 



but 
whence 



n __ i... w _ logi 

C/ - t> - t/ .'15 



lim e 8n = lim p w . 
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The formula (12) being, as easily seen, a generalization 
of the first of the formulae (10) to the infinite operations 
enables us to transfer many theorems concerning infinite 
series to the case of infinite products. 

2. Every one-to-one function f continuous in an in- 
terval a < x < b is strictly monotone (i.e. either increasing 
or decreasing). 

Our assumption implies /(a) = f(b) and we may further 
assume that /(a) < f(b) (if /(a) > /(&), then analogous 
arguments are applicable). We shall prove the function / 
to be increasing in a < x < b. Let x < x f . One has to 
prove that f(x)<f(x'). 

First of all let us note that the conditions a < x < b 
and f(a) < f(b) imply /(a) < f(x) < /(6). Indeed, otherwise 
we should have either j(x) < /(a) or f(x) > f(b). In the 
first case, the double inequality f(x) < f(a) < f(b) would 
imply (by Theorem 3) the existence of a point x" in the 
interval xb such that /(#") = j(a). But this contradicts 
the assumption that / is one-to-one (because x" ^ a). 
Similarly, in the other case a point x'" would exist in the 
interval ax such that /(#'") = /(&), in contradiction to the 
inequality x'" ^ b. 

So we have proved that f(a) < f(x) < f(b). At the 
same time we conclude that the conditions x < x' < b 
and f(x)<f(b) imply j(x) </(#') </(&). 

Thus, f(x) < /(#')> a & we had to prove. 

Exercises on 5 

1. Let /(a?) denote a function defined as follows: if x 
is an irrational number, then f(x) = 0, and if x is a ra- 

7? 7? 

tional number # = ~ (the fraction - being irreducible), 

then /(#) =.- Prove that this function is continuous at 
irrational points and discontinuous at rational points. 
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2. Prove that every function /(#), a < x < 6, one-to- 
one and possessing the Darboux property ( 5.4, Be- 
mark (a)) is continuous. 

3. Prove that every equation of an odd degree n with 
real coefficients, i.e. equation of the form x n + a n -.iX n ~ l + 
+ .,. + o 1 # + o = has at least one real root (cf. Exer- 
cise 2, 4). 

4. Prove that a continuous function satisfying the 
condition 



for any x and y is of the form /(#) = ax. 

(Prove this equation for rational X, taking a = /(I)) 

5. Find whether the function sin- is uniformly con- 

tinuous in the interval < x < 1, and the function ]/x 
in the interval < x < oo. 

6. Let j(x) and g(x) be two continuous functions in 
an interval a < x < b. Let h(x) denote the greater of 
the two values f(x) and g(x) (eventually their common 
value, if they are equal). Prove that h(x) is continuous. 

7. Given a sequence a ly # 2 , > choose a function dis- 
continuous at the points of this sequence and continuous 
at all other points. 

8. A function / is said to satisfy the LipscMtz condition, 
if a constant C exists such that the inequality 



holds for any pair x and x'. 

Characterize the Lipschitz condition geometrically. 

Prove that a function satisfying the Lipschitz con- 
dition (in an interval which may be closed or open, 
bounded or unbounded) is uniformly continuous. 

Show by an example that the converse theorem does 
not hold. 
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6. SEQUENCES AND SERIES OF FUNCTIONS 

6.1. Uniform convergence 

If to any positive integer n there corresponds a func- 
tion / n , then a sequence of functions f 19 / 2 , ..., /n? is 
defined. Let us assume all these functions to be defined 
in the same set of arguments A (e.g. in an interval 
a < x < b). If the sequence /i(#), / 2 (#0? is convergent 
for every x (belonging to A) to a limit /(#), then we say 
that the sequence of functions {f n } is convergent to the 
function f. This means by the definition of the limit 
( 2.2) that to every x and to any e > a number ft 
exists such that for n > ft the inequality 

(1) \1n(x)-1(x)\<e 

holds. 

Thus, given e > 0, the number ft is chosen suitably 
to any so, separately. However, if ft can be chosen in- 
dependently of x, then the convergence of our sequence 
is said to be uniform. Thus, a sequence {/} is uniformly 
convergent to a function f (in a set A), if to any e > 
a number ft exists such that for each n > ft and for 
every x (belonging to A) the inequality (1) holds. 

Geometrically, the uniform convergence means that 
surrounding the limit-curve y = f(x) with a strip defined 
by two curves parallel to it (given by the equations 
y = f(x) e), all curves y = f n (%) with sufficiently large n 
are contained in this strip. 

EXAMPLES. Let f n (x) = x n . We have 
lim f n (x) = for < x < 1 

n oo 

and lim f n (x) = 1 for x = 1 . 

n=oo 

This sequence is uniformly convergent in the interval 
<#< }. 

For, given e > 0, let us choose a number ft in such 
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1 1 /l\n 

way that ~ < e. Then assuming x ^~ we have x n ^ l~ j 

< --j. < s for n > k and the inequality (1) is satisfied by 

each n > k and by any x belonging to the interval 
< x < . But this means that the convergence of the 
sequence {f n } in this interval is uniform. Yet the con- 
vergence in the interval < x < 1 is not uniform. This 
is easily seen substituting e.g. s = ; moreover, it follows 
immediately from the discontinuity of the limit -function 
and from the following theorem: 

1. A limit of a uniformly convergent sequence of con- 
tinuous functions is continuous. 

Let the sequence {f n } be uniformly convergent to / 
(in a set .A) and let s > 0. Then there is a k such that 
for each n ^ fc ? the inequality 

(2) \1n(oo)-1(x)\< J* 

is satisfied for every x (belonging to A). Let a be an 
arbitrary point belonging to A. We have to prove that 
the function / is continuous at this point. Thus, given e, 
a number d > has to be chosen in such a way that 
the inequality \x a\ < d would imply 



(3) 

(for x belonging to A). 

Now, fk being continuous at the point a, a number 
d > exists such that the inequality \x a\ < d implies 

(4) 



The inequality (2) being satisfied for n = k and x ^JBL, 
we find that 

Eeplacing n in the inequality (2) by k and adding 
to the inequality obtained in this way the inequalities (4) 
and (5), we get the inequality (3), as was required. 
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Remark. As we have seen, the function j(x) = lim x n 

71 = 00 

(cf. Fig, 9) is discontinuous in the interval < x < 1. 
Thus, the limit of a non- uniformly convergent sequence 
of continuous functions may be discontinuous. Theorem 1 
and the above example illustrate the meaning of the 
notion of uniform convergence. 




FIG. 9 



Similarly as in the case of the uniform continuity 
of a function, the expression "uniform" shows that the 
number Jc chosen to a given s is independent of .x. 

The following theorem corresponds to the Cauehy 
condition for the convergence of a sequence: 

2. A necessary and sufficient condition for the uniform 
convergence of a sequence of functions {f n } is that to any 
e > a number r exists such that the inequality 



(6) \fn(x) 

holds for each n > r. 

First let us assume the sequence to be uniformly 
convergent to a function /. Then, given a number e > 0, 



. SEQUENCES AND SERIES OF FUNCTIONS 121 

there exists an r such that for each n > r, we have 
/(a?)-/(aO < ifi, whence / r (. r )_/(#)| < e . 



Adding both these inequalities we obtain the in- 
equality (6). 

Now, let us assume a sequence {f n } to satisfy the 
condition formulated in the theorem. Then the sequence 
/,(#)? / 2 (#), ... satisfies for a fixed x the Cauchy condition; 
thence it is convergent. Speaking otherwise, the function 
/(#) = lim fn(x) exists. It has to be proved that the con- 

/*=oo 

vergeiice is uniform. Let an e > be given. According 
to the assumption, an r exists such that the inequality 



(7) |/n(0)- 

holds for each n > r. . 

We shall prove that for n > r, the inequality (1) 
holds, too (with the sign < instead of <). 

Replacing the variable n by m in formula (7) and 
adding to the inequality (7) the obtained inequality 
< ij we get for m > r, 



I /() ~ fm(x) I < * , whence lim | f n (x) - f m (x) \ < e , 

7?l = 00 

i.e. 

|lim[/ n (a?)-/ w (a?)]|<c, that is \f n (x)-]imf m (x)\ <: e 

w = co m^oo 

and so 



6.2. Uniformly convergent series 

Let a sequence of functions f l9 / 2 , ... , /, ... defined 
on the same set of arguments be given. 

The series ^(x) + / 2 (o?) + ... + j n (x) + ... is called uniformly 
convergent, if the sequence of its partial sums 



is uniformly convergent. 
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If the functions /i,/ 2 ,... are continuous, then the 
partial sums s n are obviously also continuous. By the 
theorems of 6.1, we therefore conclude that 

1. The sum of a uniformly convergent sequence of con- 
tinuous functions is a continuous function. 

2. A necessary and sufficient condition for the uniform 
convergence of a series f^x) + f z (x) I ... is that to any number 
e > a number k exists such that the inequality 



holds for each n > k and for any x. 

From Theorem 2 we may deduce the following theorem 
which makes it possible to infer the uniform convergence 

00 

of a series J / 71 (;r) by comparison of the terms of this 



series with the terms of a series u n . 

71-1 

oo 

3. // a series u n is convergent and if the inequality 



S u n is satisfied for an,y ,r, then the series 2j fn(<v) 

n^l 

converges uniformly and absolutely. 

Indeed, since the series % + i/ 2 + ... is convergent, 
therefore to any given e > a number fc exists such 
that the inequality % + %-+! + ... +u n < e is satisfied for 
each n > k. Hence by the assumption, 

IM-iO + .-. + M*)!^ 

thus the formula (8) holds and, by Theorem 2, this implies 

oo 

the uniform convergence of the series ] /(#). 

71=1 

The second part of the above double inequality es- 
tablishes at once the absolute convergence of the series. 

EXAMPLE. The series % f is uniformly convergent 



in every interval a < x < a, since 



nl 

a n 



~r and the 



nl 
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series ]? - is convergent for any a ( 3.7). 



71 



We shall encounter many more examples of uniformly 
convergent series in 0.3 below. 

6.3. Power series 

A series of the form 

(9) 8(x) = + 

is called a power series. 

Thus we see that a power series is a natural generaliza- 
tion of the notion of a polynomial of degree //. The im- 
portance of power series follows also from the fact that 
the representation of a function by means of a power 
series is very advantageous from the point of view of 
practical calculations. 

Let us consider the following three examples of power 
series: 



] 






As well known, the first of these series is convergent 
for all x. The second one is convergent for \x\ < 1 and 

its sum = ; for other x the series is divergent. 

Finally, the third series is divergent for every x ^ 0. 

In order to formulate a general theorem on the con- 
vergence of power series, the notion of the "radius of 
convergence" of a power series will be introduced. Namely, 
the radius of convergence of a power series S(x) is defined 

00 

( l ) Strictly speaking, for x == the symbol a n x n (which is 

no 

in this case indefinite) has to bo replaced by a (cf. the footnote 
to the formula (6), 1). 
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as the upper bound of the set of absolute values of x 
for which this series is convergent. In particular, if the 
above set is unbounded, then the radius of convergence 
is assumed to be equal to oo. 

For example the radii of convergence of the series 
(a), (b) and (c) are oo, 1 and 0, respectively. 

The interval /<#< r, where r denotes the radius 
of convergence of a given power series, is called its interval 
of convergence. In the case r = oo, the interval of con- 
vergence is equal to the set of all real numbers. This 
terminology is connected with the following theorem: 

1. In any closed interval lying inside the interval of 
convergence the power series is convergent uniformly and 
absolutely. 

It suffices to prove our theorem for intervals of the 
form c < x < c, where a < r (because every closed inter- 
val lying inside the interval of convergence is contained 
in such an interval with the centre 0). Since r, being the 
radius of convergence, is the upper bound of the set of 
absolute values of the convergence-points of the series $(#), 
so a point b> c exists such that either 8(b) or S(b) is 
convergent. It follows from the convergence of the series 
8( &) that its terms constitute a bounded sequence. 
Thus, let M > \a n b n \ for each n. Hence we conclude that 
for \x\ <c, we have 

= Kfr'tf 

Since the series J (yl , being a geometric series with 



. (c\ 
nes 2 T , 

M-O \0/ 



quotient <1, is convergent, Theorem 3 of ti.2 implies 
the uniform and absolute convergence of the series 8(x) 
in the interval c < x < c. 

Bemark. We conclude from the above theorem that 
the series is convergent inside its interval of convergence 
and divergent outside this interval (the last follows from 
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the definition of the radius of convergence). Yet at the 
ends of the interval of convergence the series may be 
convergent as well as divergent. The following examples 
give evidence here: the series (b) is divergent at the ends 
of the interval of convergence, namely, $(1) = oo and 
the series AS y ( 1) = 1 1+1 1 +... has neither a finite 
nor an infinite limit; the series 



(representing log (1 fa?)) is convergent for x = 1 and 
divergent to oo for x 1. 

The previous theorem together with Theorem 1 of 
6.2 imply: 

2. A power series 8(x) is a continuous function in the 
open interval r < ,r < r, i.e. inside the interval of con- 
vergence. 

Indeed, to any x lying between / and r there may 
be chosen a closed interval with the centre #, lying inside 
the interval of convergence. Since the power series is 
uniformly convergent in this closed interval, it follows 
from Theorem 1 of $ 0.2, that it represents a continuous 
function. 

Applying Abel's theorem from the theory of infinite 
series ( 3.3, Theorem 2) we shall complete this theorem 
with respect to the continuity of the power series at the 
ends of the interval of convergence. 

3. ABEL THEOREM. A power series convergent at one 
of the ends of its interval of convergence constitutes a (one-side) 
continuous function at this point. 

Speaking more strictly, if the series H(r) (or AS'( >')) 
is convergent, then the series 8(x) is uniformly convergent 
in the interval ^ x < r (or in the interval r < x < 0). 

Let us assume the series S(r) to be convergent and 
let us denote by S n the ro-th remainder of this series, i.e. 
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Then wo have lim R n = 0. Let an e. > be given. 

n=oo 

Thus a number fc exists such that we have 



for * > w, > ~k. 

Let us denote by R n (%) the M-th remainder of the 
series 8(x): 



R, n (x) - On +l aP+* + a n+ *yr+* f ... 
Hence, in particular, R n (r) = R H . Let us note that 



and let us apply Abel's theorem ( 3.3, 2 and Remark (oc)) 

lx\ n + l 
after re])lacing the sequence {a n } by the sequence I-;! , 

, ... and the series fe 1 + fc 2 + --- by the series 7? w . 
Since this series is bounded by the number e and since 

//?\ m 

and lim ' -0 for 0<#<>- 



we conclude that \R n (x)\ < 2e. This inequality is satisfied 
also for x = r. Thus we have shown that if //- > &, then 
the inequality 

oo // 

V , X 1 

' (i r T ' a T 

^LJ m SLJ m ' ' 

is satisfied for any x such that <: x <_ r. This means 
that the series S(x) is uniformly convergent in this interval. 

In the case when the series 8(r} is convergent the 
arguments are analogous. 

Theorems 2 and 3 may be expressed also in the follow- 
ing way: every point of convergence of a power series is 
a point of continuity. 

Sometimes the d'Alembert and Cauchy criteria enable 
us to calculate the radius of convergence easily. Namely: 
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4. // lim - W7l - ^ g, then the radius of convergence of 

n oo (In 

the power series 8(x) is equal to r = !/</ (moreover, if g = 0, 
then r = oo and if g = oo, then r = Oj. 

Analogously, if lim |/|a w | exists, then r = '- . 



Indeed, let a? > 0. We obtain 



(10) 



lim 



= j? lim 

w oo 



Hence if x < 1/g, then the considered limit is < 1 
and so the series 8(x) is convergent (absolutely), whence 
/ > 1/g. Supposing / > I/g, the series 8(x) would be ab- 
solutely convergent for 1/g < x < r. But this is impossible, 
since then the limit considered in the formula (10) would 
be >1. 

The above arguments concern also the cases g 
or g = oo. 

The proof in the case of the Cauchy criterion is 
similar. 

6.4. Approximation of continuous functions by polygonal 
functions 

A function /(#), a < x < b, is called polygonal, if the 
interval ab may be divided into a finite number of smaller 
intervals in such a way that the function is linear in 
everyone of these intervals, separately. This means that 
there exist a system of n + 1 points 



(11) a Q < 



... < a n 



where 



a = a a n = 



and two systems of real numbers c l ,c 2 ,...,c n and 
d l , d 2 , ..., d n so that 



(12) 



for 
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For example the function f(x) \x\ is polygonal in the 
interval 1 < x < 1, for f(x) = x in the interval 1,0, 
and f(x) = x in the interval 0, 1. 

The graph of a polygonal function is a polygonal line. 
Conversely, if a polygonal line is the graph of a function, 
then this function is a polygonal one. 

Sometimes we are dealing with approximation of 
curves by polygonal lines (e.g. in the elementary geo- 
metry, calculating the length of the arc of a circle, we 
approximate this arc by inscribed and circumscribed 
polygonal lines). 




FIG. 10 

The following theorem expresses analytically the ap- 
proximation of curves given by continuous functions by 
polygonal lines (given by polygonal functions): 

THEOREM. Kvery continuous function f in an interval 
a < x < b is the limit of a uniformly convergent sequence 
of polygonal functions. 

For each n, we consider the partition of the segment 
ab into n equal segments: aa 1? a^a^ ..., a^-\b (thus we 



have iii general a k = a + k ). We draw a polygonal line 



IV 



through the points [a, /(a)], [a n /(a x )], ..., K, f(a n )]. 
This polygonal line is the graph of a certain polygonal 
function /. We shall prove that the sequence of the 
functions f n is uniformly convergent to the function /. 
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According to the uniform continuity of the function / 
in the interval a&, to any given e > a number d > 
may be chosen so that the inequality \x x'\ < d implies 

) /(#')!< e. Let m> . We shall prove that for 



n > in we have the inequality 

(13) \f n (x)-f(x)\<2e 

for every x belonging to the interval ab. 

Indeed, let x be given and let n > m. Moreover, let 
the point x belong to the interval a^-i^k (of the n-th 
partition). Since the length of this interval is <<5, so 

(14) |/(a A .- 1 )-/(a jfe )| < s and \f(x)-f(a k )\ < e . 

Let us suppose that /(%_i) </(a&) (if /(&-! ) >/( a fc)? 
then the arguments are analogous). Then the function f n 
is non-decreasing in a k ^a k ^ since it is linear. Thus 

(15) /(*-i) </n(a?X/n (*) 

Since, according to the definition of the function / n , we 
have /(ajb-i) /(fc-i) and /(*) == /(*), so j(<*k-i) < /n(#) 
< /(%) and this gives, according to the first of the in- 
equalities (14), \fn(x) j( a k)\ < Comparing this inequality 
with the second of the inequalities (14) we obtain the 
formula (13). 

We shall now cite without proof the following Weier- 
strass theorem, analogous to the previous one: 

Every junction continuous in an interval a ^ x < b is 
the limit of a uniformly convergent sequence of polynomials. 

6.5*. The symbolism of mathematical logic 

In order to understand better the notions and the 
theorems of mathematical analysis, a knowledge of the 
notation of definitions and theorems by means of some 
symbols used in mathematical logic is required. 

We shall give here the principal notions and symbols 
employed in mathematical analysis. 

9 
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Given two sentences a and /?, we denote by av/? the 
sentence "a or /?" (the sum, i.e. the alternative of the 
sentences a and /?); a A ft will denote the sentence "a and /S" 
(the product, i.e. the conjunction of the sentences a and /?). 

Every sentence has one of the two values: truth (in- 
dicated by the figure 1) and falsehood (indicated by 0). 
A logical sum avft is a true sentence, if and only if at 
least one of its terms is a true sentence. Similarly, 
a logical product a A is a true sentence, if and only if 
both its factors are true sentences. 

It is easy to show that logical addition and multi- 
plication possess the properties of the commutativity and 
the associativity: 

ay ft = ftva, a A/? /?Aa, aV(j8vy) ==- (V/J)Vy, 

aA(/?Ay) (aA/3)Ay. 
The laws of distributivity also hold: 
-- (aA/?)v(aAy) 

and a 



Besides the above two operations, the negation of the 
sentence a, indicated by ^, is also considered. It is 
clear that the sentence ~a is true, if the sentence a is 
false, and is false, if the sentence a is true. Moreover, 
it is immediately seen that 

(16) ~( ~a) = a 

(two negations are reducing themselves). 

The following two theorems (so-called de Morgan laws) 
may also be easily proved: 

(17) ~(aV/J) = (~a)A(~j8) 

and 



The first of these two theorems states that the sentence 
that one of the two sentences a and ft is true, is a false 
sentence if and only if both sentences ^a and ~p are 
true, i.e. if and only if both sentences a and ft are false. 
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The second theorem states that "it is not true that 
both sentences a and /3 are true, simultaneously", if and 
only if at least one of these sentences is false. 

Besides the operations of addition, multiplication and 
negation, the relation of implication is considered in the 
logic of sentences. Namely, we write a->/5 in order to 
denote that the sentence a implies the sentence /?, i.e. that 
if a is true, then /? is true, too; in other words, either a 
is false or /? is true. This means that the sentence a->/5 
is equivalent to the logical sum ( ~ a) v /?. Hence it follows 
also by the formulae (17) and (16) that 

(18) ~(a->|8) = aA(~/J). 

The operations of addition and multiplication may be 
extended to a finite number of terms or factors by 
induction. The generalization of these operations to an 
arbitrary number (finite or infinite) of terms or factors 
plays a great role in applications. We perform it in the 
following way. 

Let <p(x) be an expression containing a variable x 
and becoming a sentence (true or false) after substituting 
in place of x any value of x. Such an expression is called 
a propositioned junction.] e.g. the expression x > 2 is 
a prepositional function. It becomes a sentence, when 
we substitute any real number in place of x; however, 
it is riot a sentence. We say that the values of the variable x 
for which y(x) is a true sentence, satisfy this propositional 
function. 

We perform the following two operations on the pro- 
positional functions: 

(19) NM^) and A? ()- 



The first expression is read as follows: "a certain x satis- 
fies the function <p" (that is "there exists an # such that 
<p(x Q ) is true"). The second one means that "every x 
satisfies the function <p (a?)" (that is "for every x the 
sentence <p(x) is true"). 
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As is easily seen, the expressions (19) are sentences; 
e.g. V (> 2 ) is a * ruc sentence and f\ (x> 2) is a false 

X X 

sentence. Generally, by adding the operator /\ or V 

X X 

(these operators are called the universal and the existential 
quantifier respectively) before a prepositional function we 
transform the prepositional function into a sentence. 

Writing the variable x we have to realize the domain 
of this variable (this domain is often suggested by the 
symbolism); e.g. fo^r the prepositional ' function x > 2, 
the domain of the variable x is the set of real numbers. 

In the case when the domain of the variable is finite, 
the quantifiers V an d A are generalizations of the 
operations v and A, respectively. Indeed, if the domain 
of the variable x consists of n elements t , 2 , ..., a w , then 



The de Morgan laws may be generalized to the quan- 
tifiers. In this way we have the theorems: 

(20) ~V <p(%) = A ~9(#) and ~A <p( x ) = V 



Indeed, "it is not true that there exists a value of x 
for which y(x)" is a true sentence, if and only if the 
sentence y(x) is false for every as, that is if the sentence 
~y(x) is true. 

The second de Morgan formula may be shown to be 
true, similarly. 

Besides prepositional functions of one variable, pro- 
positional functions of two or more variables are con- 
sidered; e.g. y = x z is a prepositional function of two 
variables (we might denote this function by y(x, T/)); 
it becomes a sentence after substituting in place of the 
variables x and y some values of these variables. Similarly, 
is a propositional function of three variables. 
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Let us now write the definition of the limit of an 
infinite sequence (cf. 2.2) by means of these logical 
symbols: 

(21) (g - lim a n ) ^ A V A [(' > *) ->( K~ ff| < *)] ; 

tioo e k n 

here the domain of the variables n and A: is the set of 
positive integers and the domain of the variable e is the 
set of positive numbers. 

Similarly, the Cauchy condition, necessary and suf- 
ficient for the convergence of a sequence {a n } (cf. 2.7,, 
is expressed as follows: 

(22) 



The definition of the boundedness of a function / 
in an interval a < x < b (cf. 4.7) is written as follows: 



(23) 

M x 

The (Cauchy) definition of the continuity of a func- 
tion / at a point X Q (cf. 5.2 (3)) may be written in the 
following A\ay: 

(24) A VA l(|A| < t)^(\f(z, + &) -/(*.)] < e)] 

e d h 

Here the domain of s and d is evidently the set of 
positive numbers and the domain of the variable 7i, the 
set of all real numbers. 

Since, according to the definition, a function is con- 
tinuous in a given set (e.g. for a < x < b) when it is 
continuous at every point of this set, so to write the 
definition of continuity in a set by means of the logical 
symbols, one has to precede the expression in the for- 
mula (24) by the quantifier A replacing of course x 

X 

by x. In this way we obtain: 

(25) A A VA [(|A| < a)-M]/(3 + *)-/(s)| <)] - 

x B 6 h 

Before proceeding to further applications of the logical 
symbols, we note a few simple properties of the quantifiers. 
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Let a prepositional function <p(x, y) of two variables 
be given. It may be easily verified that the formulae 

(26) A A v(x, ?/) = A A <p(x> y) 

x y y x 

and VV <?(x,y) = VV ?(#>#) 

x y y x 

hold. 

Thus, as we see, the order of two universal quantifiers 
may be changed, as well as the order of two existential 
quantifiers. However, this is not true in the case of two 
different quantifiers V anrt A? < changing the order 
of the quantifiers in the formula (23) expressing the 
condition of boundedness of the function / we obtain 



(27) 

x M 

but the last condition is satisfied by every function 
(and so by unbounded functions, too), which is seen 
substituting M = | / (x) | + 1 . 

So the order of the quantifiers V aiR t A ^ s essential; 
e.g. it is essential in the condition (23) (for the boundedness 
of the function /) that the number M does not depend 
on the variable #; in the condition (27) it is quite opposite: 
we choose the number M to each x, separately. As is seen, 
the dependence of a certain quantity on another one is 
expressed by the order of the quantifiers; thus, it follows 
directly from the notation. Similarly, in the definition (24) 
(expressing the continuity of a function / at a point # ) 
the order of the quantifiers f\ and V means that d 

e 6 

depends on e (and not conversely). 

We illustrate this situation further by two especially 
instructive examples, namely, the example of uniform 
continuity and that of uniform convergence. 

First let us note that changing the order of the quan- 
tifiers /\A i 11 ^ e formula (25) (expressing the con- 

x e 

tinuity of a function) we obtain an equivalent sentence 
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(since the change concerns the same quantifiers, cf. the 
formula (26)): 

(28) A A V A |(l*l < *)->(!/(+ *)-/(*)! < *)1 

e X d h 

However, changing the order of the quantifiers A V 

X d 

ill the formula (28) we obtain a non-equivalent formula, 
namely 

(29) A VA A [(1*1 < *) ->!/(+*) -/(*)[ < )j , 

e ft x h 

i.e. the condition of the uniform continuity of the func- 
tion / in the considered set (cf. 5.4); but not every 
function continuous in the interval a < x < b is uniformly 
continuous (e. g. the function l/o? is continuous in the 
interval < x < 1 but it is not uniformly continuous in 
this interval, cf. the remark to Theorem 1 of 5.4). 
Although for closed intervals a < x <; &, the usual con- 
tinuity implies the uniform continuity, but this requires 
a special proof (to pass from the formulation in Theorem 1, 
of 5.4 to the formula (29), x' has to be replaced by x f h). 
Comparing the formulae (28) and (29) we conclude 
that they differ only by the order of the quantifiers A 

X 

and V- However, this difference is very essential: the 

6 

order VA O n t^ e formula (29)) expresses the inde- 

d x 

pendence of the number d of the variable x and "uni- 
formity" of the continuity of the function / consists just 
in this fact. 

Now, let us proceed to the notion of the uniform 
convergence of a sequence of functions (cf. 6.1). Let 
a sequence of functions / 1? / 2 , ..., /, M ... defined in a certain 
set (e. g. a < x < b) be given. Let us assume this sequence 
to be convergent to a function /. This means by the 
formula (21) (after substituting y = /(#), a n = / n (#)) that 

(30) 
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As is known, the order of the quantifiers A /\ may 

X e 

be changed in this formula. However, if we change also 
the order of the quantifiers A all( l V? then we obtain 

u; k 

the formula for uniform convergence: 

(31) A VA A [(> fc)^(!/n(*0-/M| < e)\ . 

e k x n 

For, the order of quantifiers in the formula (31) shows 
that the number k does not depend on x (but only on e) 
and this means that the convergence of the sequence of 
functions /i,/ a , ... is uniform. 

To conclude these remarks we add that sometimes 
it is convenient to apply the logical symbolism and 
especially the de Morgan formulae to proofs performed 
by reductio ad absurdum. 

For this purpose let us note that the de Morgan 
formulae (150) may be applied to prepositional functions 
of many variables; they give the following formulae: 

~ V A ?(*>#) = AV~ v(x,y), 

(32) XV 

~ AVAff>0i *) ^ VAV~y(*>y,s) etc. 

x y z x y z 

For example in the proof of the theorem on the 
uniform continuity of functions continuous in a closed 
interval (cf. 5.4, 1), we use the condition of the uniform 
continuity given in the following formulation (which does 
not differ essentially from the formula (29)): 

A V A A [(I*-*'! < *)-MI/(*)-/(*')l < e)] . 

We write the negation of this condition, which gives 
according to the formulae (32) and (18), 

V A VV \(\x~x'\ < ) A (\1(x)-1(x')\ > e)] . 

t d X X f 

The continuation of the proof remains unchanged. 
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Exercises on 6 

1. Prove that the sum of two uniformly convergent 
sequences is uniformly convergent. Prove the same for 
a product, assuming a < x <; b. Show by considering the 

example / n (#) = xil ), y n (x) -- that the theorem 

y HI i 3c~ 

on the product is false for open intervals. 

2. ProA r e that the radius of convergence r of a power 

oo 

series JV a n x satisfies the (Cauchy-IIadamard) formula: 
/<-o 

1 v n , . 

= limsup \ \a n \ . 

3. Let a sequence of continuous functions / ly / 2 , ... in the 
interval a C x < 6, be given. Prove that this sequence is 
uniformly convergent to a function /, if and only if the 
condition \in\x n =-w implies lim/ n (j? n ) ^f(x). 

?l=00 ?J, = 00 

4. Investigate the uniform convergence of the sequence 
of functions 

f n (x) x n (l - x n ) , < x < 1 

and j n (x) = - - , < a; < 1 . 

'!/ 

5. Prove that the series 

8(x) =x(l x) x(l x) + ...'tx n (l-~x) x(l-x) + ... 

is uniformly and absolutely convergent in the interval 
^x <1. 

Rearrange the terms of this series in such a way to 
obtain a nonuniformly convergent series in this interval. 



CHAPTER Til 

DIFFERENTIAL CALCULUS 

7. DERIVATIVES OF THE FIRST ORDER 

7.1. Definitions 0) 

Let a function / be given in an open interval con- 
taining the point a. The limit 



is called the derivative of the function, f at the point a. 
The function 

,_+=>, 

the limit of which is considered by h tending to 0, is 
called the difference quotient of the function f at the point a 
for the increment h. 

The derivative is written symbolically as follows: 



or more briefly, f'(a). Yet more briefly, writing y = f(x) 
we denote the derivative of a function / at an arbitrary 

fjfti 
point x by ^ (the derivative "dy over dx"). By this 

cLx 

symbolism (originating with Leibniz), the derivative is 
represented as a quotient of two differentials dy and dx 

du 
(cf. 7.13). However, the symbol must be treated 



(*) The differential and integral calculus was created by Newton 
and Leibniz on the end of the 17th century. 
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as a whole, attributing to the differentials no separate 
mathematical significance. 

Geometrically, the derivative is interpreted as follows. 
Let a curve y /(#) be given. Let us draw a straight 
line through the points [a , / (a)] and [a + ft , / (a + ft)] , 
ft being a fixed positive value. This straight line is called 
a secant with regard to the given curve. It is easily seen 
that the difference quotient g(h) is the tangent of the 
angle a h between the secant directed by the increasing 
abscissae and the positive direction of the X-axis. The 




a+h 



FIG. 11 

limiting position to which the secant tends as ft tends 
to will be considered as the position of the tangent. Thus, 
(2) /'(a) -tan a, 

w r here a is the angle between the positive direction of 
the tangent to the curve y = /(,r) at the point a and the 
positive direction of the X-axis. 

Not every continuous function possesses a derivative, 
i. e. not every curve possesses a tangent at any point. 
E. g. the function /(#) =-- \x\ does not possess a derivative 
at the point 0, for in this case 



h 



and 



ft 
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In this case we may speak about one-side derivatives 
which are equal to 1 and 1, respectively. Generally, 
a right-side or left-side derivative is the right-side or 
left-side limit: 



respectively. 

However, there exist continuous functions which do 
not even have a one-side derivative. It is easily seen that 
the function / defined by the conditions 



(4) j(x)=x$m- for 



^O, /(O) - 
is continuous but has no derivative at the point 0. 




FIG. 12 



For, substituting for //, the two sequences of values 



2 



2 2 2 



we get in the limit 1 in the first case and in the second 
one, 1. 

The non-existence of the derivative /'(O) follows also 

from the non-existence of the limit lim sin-, since we 

9 
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should have 



(of. 4 (8)). 

There exist still more singular continuous functions, 
namely functions which do not have a derivative at any 
point; thus, they represent continuous curves which do 
not have a tangent at any point. 

Besides finite derivatives we consider also infinite 
derivatives. For example we shall prove that 



CO . 
= + 



l d }*\ - lim t?-*- lim -oo 



.Indeed, 



for iim// 2/3 =- 0. Analogously lim | h + 0, whence the 

7t-0 ' A=-'!0 

second formula follows. 

A function is called differentiable in, an open interval 
if it has a finite derivative at any point of this interval; 
in saying that a function is differentiable in a closed 
interval a < x -^ b we assume that it has a derivative 
at any point inside this interval and one-side derivatives 
at the ends of this interval. 

Similarly, the assumption of continuity of the de- 
rivative /'(#) in the interval a < x ^ b means that this 
derivative is continuous inside the interval aft, the right- 
side derivative is right-side continuous at the point a 
and the left-side derivative is left-side continuous at b. 

By a normal to a curve y = f(x) at a point [#,/(#)] 
we understand a straight line perpendicular to the tangent 
at this point and passing through this point. 

According to the geometrical interpretation of the 
derivative given above, the tangent to a curve at a point 
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(#, ?/), where y = /(#), is expressed by the equation 

(5) ^WM or X = x if /'(*) =00; 




J\T and Y denote the eoordinates on the tangent. 

Thus, the equation of the normal to a curve at a point 
(j?, y) is: 

01 r== > if /'(*)=<*> 



Besides the geometrical interpretation the derivative 
has also important interpretations in physics. In particular, 
the velocity of the point moving along a straight line is 
expressed as the derivative of the distance with respect 

ds 

to the time: = -^-, where the distance s travelled is 
at 

expressed as a function of the time: s = f(t). Thus, the 
velocity at a moment /, is the limit of the mean velocity 
in the time from /, to + /?, if li tends to 0; for the dif- 
ferences quotient is just this mean velocity. 

7.2. Differentiation of elementary functions 

Krst let us note that 

1. // a junction / is differentiable at a point a?, then, 
it is continuous at this point. 

j(x-}- fe) _ I (x) 
Indeed, since the limit lim^ --- 1~-L V :J exists by 

7j = h 

assumption (and is finite), we have 

^-lim* - , 

h~o ^=o 7<=o 

whence 

lim/ (a? + A) =/(*), 

7i-0 

which means that the function / is continuous at the 
point x. 

2. Let a junction / have a constant value: /(#) = c. 

Then ~ - 0. 
ax 
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For, we have j(x + h) = c /(#), whence 



h=o 



, j l + ^ .r 

for lim- - -T ----- = Inn - = 1. 

h^O ft h-Q ft 

The following formulae concern tlie differentiation of 
a sum, a difference, a product and a quotient of two 
functions y = /(j?) and z = g(jc), differentiate at a point xi 

d(y^z) dy dz d(yz) dz ^dy 

r. ' --- ~ ' = ^- '-. " ~T~ ~-j ~ ') -i L - zr '/ ~^ T ^ ~ : 7~ 

<te cZa? rZ^ dx dx dx 

dy dz 
d(yj~) _ "llx~ y dx 
dx z~ ' 

whence 



The proof of Formula -i follows from the equations 

\J(x)-\-g(x)i 



A-0 



_ Hrr, - ,. 

mil 7 ~7 inn 



7 ~7 . ^ P . 

ft ^o ft dx dx 

The proof for the difference is analogous. 

In the proof of Formula 5 we shall apply the con- 
tinuity of the function / at the point x (cf. 1); thus we 
have lim/(# + ft) f(x). Now, 

7i=0 

'<j(x + ft) -f(x 



dx h ^n h 

- lim [ - f - ( 



ft 

/(^ + ft) 
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(* + /*) lim 



dz Ail 

f + s^-. 

Ax dx 

To prove 6, we shall prove first 0'. 

^-Ifanir ..... A ___ LI 
dx ft=o/4</(^ + /0 g(x)\ 

1 1 g(^ I -ftgfo) 1 <fc 



for \m\(j(x + h) </(#) = s (moreover, since r/(ir) ^ 0, tliere 

7i=0 

exists a d > such that jf(a? + ft) 7^ for |//| < A). 
Formulae 5 and (>' imply 6: 

d(yjz)^d^l 1\_ J^A\,l^_l/^^//_ ^\ 
dx ~ dx\ J 'z)~ ' y 'dx\aj + z dv~ &\ a dx y dx} 

(in the first of the above equations we apply the notation 

d . , . , . dF(x) . 

--jP? in lee of ~-^ ). 

dd? ' 

= c in formulae 4 and 5 we obtain 



JL' liJUl 111 IJ1UV'< 

fj ?V\ X ' - 1 - 

<t'**/ 

Substituting 
immediately: 
<Z(i/ + c) 


^/(j?) c i 
dy 


dx 
r , ^(c?/) 


dx' 

du 

/* ".. 



The first of these formulae means that a translation 
of a curve, parallel to the Y-axis has uo influence on 
the value of the angle between the tangent and the 
X-axis; the second one means that a change of the scale 
on the Y-axis influences the tangens of the considered 
angle in the same proportion. 

Applying Formula 5 and the principle of induction 
we prove easily that for integer exponents n > 2 the 
formula 



. 



dir 
holds. 
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It is immediately seen that this formula holds also 
for n = and for n = 1, assuming that if x = 0, then 
in the case n = the right-side of the formula has to 
be replaced by and in the case n = 1, by 1 (as For- 
mulae 2 and 3 show directly). 

This formula remains also true for negative integers n 
(when x / 0). Namely, we have in this case, by 6' and 7: 

d(x n ) 1 / 1 \ 1 d(x~ n ) n 

^ !_ . I 1 . __j L _. / n 1 . ^jn 1 

dx dx\x~ n ] x~- n dx x~- n 

Later we shall generalize formula 7 to arbitrary real 
exponents (for x > 0). 

From the formulae already proved we deduce easily 
the formula for the derivative of a polynomial: 

8. (o + a x + ...+a n x n ) = %+ 



We shall now calculate the derivatives of the trigono- 
metric functions. 

ds'mx 

9. ^ = cos,r . 
dx 

fi 
10. 



dx 

A 
11. 



dx cos 2 a? " 

We shall base the proof of formula 9 011 the formula 
for the difference of sine known from trigonometry and 

on the formula lim -^ = 1 proved in 4.5, (5). Now, 



dsinx 
dx 



T lr - / , 1.V - -, V 2 - * / , * 

= lim T [sm(o? + h) sm#] = lim - - sin- - cos I x+ ^ 
A=o n h=Q h * \ A 



v sin(fc/2) v , 

lim ,, ' ' - lim cos \x+ ~\ = coso? 



/ , h\ 
\x+ ~\ = 
\ ^/ 

by virtue of the continuity of the function cos a?. 

10 
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Similarly, 



1 2 . h . 

,. sin (Jil2) n . . / M 
= hm limsml#+ -I == sinx* . 

According to 6 Formulae 9 and 10 imply Formula 11, 
for we have 



1 / d&inx . deosx\ 

.-= ~~ cos^- 3 -- smx = 



- --- - . ~~ = 

ax ax\co8x/ cos 2 x \ ax ax / 



I'V^V^fJ A/ >J*iA W I 

COS 2 0? COS 2 

dlog,T 1 -_. 

12. __2_ = _ . More generally, 



^ . 

^ #loga 

Indeed, according to the general properties of loga- 
rithms ( 5.4, (10) and (11)) we have: 



Let us substitute y -. Since lirm/ 0, we have 
(cf. 4, (16)): 

X 

i i r/ A\*I 

lim T [log(ip + fe) log a?] = -limlog 1 + - 
A=O ^ ^ h=o i\ 1 J 

1 1 

= - limlog (1 +y} y . 

X 2/=0 
1 

Moreover, since lim(l - r y)v--=e (cf. 4, (19)) and since 
i/=o 

log^ is a continuous function at the point z = e, we 
have (cf. 5, (6)): 

i i 

i = loglim(l f?y)^ = 
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Thus 



The second part of Formula 12 follows according to 
Formula 5' from the first one: 



d , d llogx\ 1 

. .__ Jop* 7? -..-- I I . 

dx dx \\oga ] log a 



dlogx __ 1 
dx #loga " 



Further formulae on differentiation of elementary func- 
tions will be deduced from the general formula on the 
derivative of an inverse function. 

7.3. Differentiation of inverse functions 

Let a differcntiable and one-to-one function y = /(#) 
be given in an interval a < x < b. As it is well known 
( 5.5, 1 and 2) there exists a function x = g(y) inverse to 
the given one and continuous in the interval /(&)<# =^/(&) 
or f(b) < y < : /(a), respectively (depending on that whether 
the function / is increasing or decreasing). We shall prove 
that the function g is differentiable in this interval. 
Namely, 

i fa^i.fy u d y^Q 

_L. ., JL . ^r~ If ~^r- ^ U . 

dy dx dx 

Given a?, let us write k = f(x + h) f(x). Then j(x + h) 
2/ + fc, i.e. # + /*< g(y + lc), whence h = g(y + k) g(y). 
With variable fe, the increment A is a function of fc. 
By the continuity of the function g, we have limh 0; 

fc=0 

moreover, we have h ^ for fc 7^ 0, since <7 is one-to- 
one. Applying formula (16) of 4 we obtain: 



h 1 



- ____ __ ____ _ = ^ = , _ 

-o /(*+)-/() " dy' 

dx 
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Iteuiarks. (a) As at the ends of the interval of ?/, 
i.e. at the points j(a) and /(ft), one-side derivatives 
exist, then our formula becomes of the following form: 

i' 1 -d*L 

JL . .- .1 I -. ~ , 

dy dx 

where the signs are the same for increasing functions 
and opposite for decreasing functions. 

For if the function / is increasing, then the function g 
is also increasing and the increments h and k have the 
same sign and consequently, lim A = + and lira // 0. 

fc=* + k=*o 

Yet if the function / is decreasing, then lim A 

/c=-fO 

and lim A = +0. 

fc = -0 

(P) Geometrically, Theorem 1 may be illustrated as 
follows. 

Let us denote by a the angle between the tangent 
to the curve and the .Y-axis and by ft the angle between 
this tangent and the Y-axis (cf. Fig. 11). Then tan/5 
cot a, i.e. tan/? = I/tan a according to Formula 1. 

(y) Formula 1 exhibits the convenience of the Leibniz 
symbolism: in passing to the inverse function the de- 
rivative -~ behaves like a fraction. 
ax 

Now, we shall give some applications of Formula 1 
in the differentiation of elementary functions. 

dc x da x 

2. = e x . More generally: 2'. = a^loga. 
doc cloo 

Let us write // = e?, i.e. x = logy. Since, by 12, 

dx 1 , du ^ dx . ^.^ .. 

_- = - we have -~ = 1:^- = u. bubstituting v e x we 

dy y' dx dy J s J 

obtain Formula 2. 

The proof of Formula 2 / is completely analogous. 

dare sin ^ 1 

o. 



dx j/1 



4. 
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dare cos a? _ 1 

dx j/i x 2 

<J arc tan #? 1 



" ~dx ^ T+a? ' 

To prove 3, let us write y arcsin.r, i.e. x sin/y. 
Then we liave 



Y ' = cosy/ = i/l sin 2 // = \I x 2 

(where the root has the sign + since JTI < y < ITT 
according to the definition of the function arc sin #, cf. 4.4). 

Hence - _ . 

dx \ 1 x* 

Similarly, writing // = arc cos x, i.e. x --= cos/y, we have 



i ___ __ 

~ - -sin/y - - ] 1-eos 2 ?/ = - |- l-.r? 2 , 



i d?/ -1 

whence -^ ---- . 



Finally, if ?y = arc tan ^, then .7? tan// and so 

^ , 4. o -, , > i <Zy 

^ ^ ^. tan 8 -?/ = 1 +^' 2 , whence -=^ = 

* ' 



^. , -= 

dy cos 2 // * ' dx 

Before we proceed to formulae concerning the super- 
positions of the elementary functions considered above 
we shall prove some general theorems on the derivatives. 

7.4. Extrema of functions. Rolle theorem 

Let a function / be defined in a neighbourhood of 
a point a (i.e. in a certain interval containing this point 
inside). If there exists a d > such that the inequality 
\U\ < 6 implies the inequality 



(7) /(a + *) 

then we say that the function / has a maximum at the point a. 
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Further if the inequality \h\ < 6 implies 

(8) 



then we say that the function f has a minimum at the point a. 

In other words, a point a is a maximum (or a mi- 
nimum) of the function /, if such an interval surrounding 
the point a exists that /(a) is the greatest (or the least) 
among all values of the function / in this interval. 

Beplacing the signs < and > in formulae (7) and (8) 
by the signs < and >, we obtain the proper maximum 
and minimum, respectively. 

The maxima and minima have the common name 
extrema. 

EXAMPLES. The function # 2 has a minimum at the 
point 0; the function sin# assumes its maximum and 
minimum values at points being odd multiples of JTT, 
alternately. 

As regards the relation between the notion of the 
extremum of a function and the upper and lower bounds 
of this function we note first of all that the notion of 
the extremum is a local notion and the notion of the 
bound of a function is an integral notion: we speak about 
the extremum of a function at a given point and about 
the bound of a function in a given interval. To state 
whether a function has an extremum at a point a it 
suffices to know the values of this function in an arbitrary 
neighbourhood of the point a. On the other hand, to 
find the upper bound of a function in an interval we 
must know the behaviour of this function in the whole 
interval. 

It follows immediately from the definition that 

1. // a junction /(#), a < x < fe, attains its upper 
bound at a point c lying inside the interval ab (i.e. a < c 
< b), then the function has also a maximum at this point. 

An analogous theorem concerns the lower bound and 
the minimum. 
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Yet if the upper bound of the function is attained 
at one of the ends of the interval aft, then it is not 
a maximum of this function, since the function is not 
defined in any neighbourhood of the ends of this interval. 
E.g. the function y = x considered in the interval < x 
< 1 attains its upper bound at the point 1; however, 
this is not a maximum. 

2. If a function f is differentiable at a point c and has 
an extremum at this point, then f'(c) = 0. 

Let us assume the function to possess a maximum 
at the point c (in the case of the minimum, the arguments 
are analogous). Let a number d > be chosen in such 
a way that the inequality f(c + h) f(c) < holds for 
\h\<d. Thus 

^ ^ for h > 



h 

and 



h 
Since the derivative f'(c) exists by assumption, we have 

f + (e) - f(e) = f-(c) . 

At the same time it follows from the previous inequalities: 
f'+(c) <0 </L(c). Hence 



Remark. The converse theorem does not hold: the 
equality f'(c) = may be satisfied although the function 
does not possess an extremum at the point c. It is so 
e.g. in the case of the function of at the point 0. 

Geometrically, the existence of an extremum of the 
function / at a point c means (in the case when the 
function is differentiable), that the tangent to the curve 
y = f(x) at the point [<?,/(<?)] is parallel to the X-axis 
(or is identical with the Y-axis). 

3. EOLLE THEOREM. Let the function f be continuous 
in a closed interval a < x ^ b and differentiable inside this 
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interval. If f(a) = /(ft), then a c exists such that a < c < b 
and f(c) = 0. 

Indeed, if the function / is constant, then we have 
f'(x) = for every x lying between a and b; hence, in 
this case we may take any value of x as c. 

Thus, let us assume that the function / is not constant 
everywhere, e.g. let us assume that / has values > f(a). 
Denoting by M the upper bound of this function, we 
have then M > f(a). According to the Weierstrass theorem 
( 5.4, 2) there exists a c in the interval ab such that 
f(c) = M. Moreover, a ^ c ^ ft, since f(a) = /(ft) by as- 
sumption. Thus a < c < b. This means that the function / 
attains its upper bound at a point c lying inside the 
interval aft; according to Theorem 1, the function / 
possesses at this point a maximum, and by Theorem 2, 
we have /'(c) = 0. 

Eolle theorem is easily understood geometrically: 
if a curve (having a tangent at every point) crosses the 
JT-axis in two points, then at a certain point the tangent 
to this curve is parallel to the X-axis. 

E em ark. Kolle theorem may be expressed also in 
the following form: if /(#) = /(# + //.), then a exists 
such that 

(9) f(x+0n)=Q, 0<0<1; 

here the same assumptions on the continuity and the 
differentiability of f(x) are made as in Eolle theorem 
(yet we do not assume that li > but only that h -/= 0). 

1.5. Lagrange (*) and Cauchy theorems 

Let us assume as in the Eolle theorem that the func- 
tion / is continuous in the interval a < x < ft and dif- 
ferentiable inside this interval. Then we have the 



(*) Joseph Louis Lagrange (1736-1813), the most eminent ma- 
thematician of the 18th century, one of the authors of the theory 
of differential equations. 
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(Lagrange) mean-value theorem (called also the theorem of 
' 'f inite increments" ) : 

i'^-a 

where li = b a and is a suitably chosen number such 
that < 9 < 1. 

Before proceeding to the proof we interpret the above 
formula geometrically. Its left side means the tangent 
of the angle a between the X-axis and the straight line 
joining the points [a, /(a)] and [b, /(&)]. Hence the theorem 




<;. 13 



states that there exists a tangent to the curve which is 
parallel to this straight line (the "secant to the curve"). 
A special case gives Bolle theorem, namely, when this 
secant is identical with the A r -axis. We shall reduce the 
proof of the Lagrange theorem to this theorem. 

Let us draw a straight line parallel to the Y-axis 
through an arbitrary point x lying between a and b 
(cf. Fig. 13) and let us denote by g(x) the length of the 
segment of this straight line contained between the curve 
and the above defined secant. Thus the length of the 
segment contained between the X-axis and the secant is 
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g(x)+f(x). On the other hand, this length is f(a) 
+ (xa) tan a, whence 

(10) 



The function g satisfies the assumptions of Kolle 
theorem. It is continuous in the interval a < x < b, 
differentiate : 



and g(a) = == g(b). Hence the function g'(x) vanishes at 
a certain point between a and b. In other words, a 9 
exists such that < < 1 and that 



g'(a + 0h) = , i.e. - -f'(a + 0h) + . 

o a 

So we have obtained Formula 1. 

Eemarks. (a) The geometrical considerations have 
been only of a heuristic character here; they make clear 
why the function g is introduced. However, the proof 
of the Lagrange theorem might begin with the definition 
of the function g by means of the formula (10). 

(P) Analogously to the formula (9), the equation 1 
may be also written in the following form: 

(11) 1(x + h) = f(x) + h-f'(x+9h) . 

Lagrange theorem implies the following two corol- 
laries, being of fundamental importance in the integral 
calculus. 

3. // /'(#) = for every x lying inside the interval ab, 
then the function f has a constant value in this interval. 

For, according to (11) we have f(x + h) = f(x) for any x 
and h and this means that / is of a constant value. 

4. // we have f'(x) = g'(x) for all a < x < 6, then 
f(x) = (/(#) + constans, i.e. the functions f and g differ 
by a constant. 
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Indeed, [/(#) #(#)]' = t'(x) g'(x) = and this means 
that the function f(x)~g(x) has the derivative =0 
everywhere. Hence, by Theorem 3, this function is con- 
stant. Writing f(x) g(x)=^C we have f(x) = g(x) + C. 

Eemark. Making in Theorem 3 the additional as- 
sumption that the function / is continuous in the whole 
interval a < x < b, this function is of constant value also 
in this whole interval. Namely, we may substitute x a 
in the proof. 

A similar remark concerns Theorem 4. 

Lagrange theorem may be generalized as follows: 

5. CAUCHY THEOREM. If the functions f and / x are 
continuous in the whole interval a < x ^ b and differentiate 
inside this interval and if f[(x) ^ for any x, then 



where h = b a. 

Lagrange theorem is obtained from Cauchy theorem 
by making the substitution / x (#) = x. Conversely, to prove 
Cauchy theorem let us replace the function g(x) in the 
formula (10) by the following function: 



(Let us note that f t (b) -- f^a) according to the assumption 
f^x) ^ and Rolle theorem.) 

This function satisfies the assumption of Eolle 
theorem: 



(13) gi(x) = ^f(x) + f l (x) , 9l (a) = 



Thus there exists a between and 1 such that 
g'(a + &h) - 0. Substituting x - a + 0h in the formula (13), 
we obtain equation (12). 
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Analogously to the formulae (9) and (11) we obtain 
from Cauchy theorem: 



MX + h) - MX) " 1((x 

Remark. It is essential in the Cauchy formula that 
9 indicates the same number in the numerator and in 
the denominator. A direct application of Formula 1 to 
the function / and to the function / x and the consideration 
of the quotient of the obtained expressions leads (in 
most cases) to different numbers in the numerator and 
in the denominator. 

7.6. Differentiation of composite functions 

Let y = f(x)j z ~ S(y)f where the function g is defined 
for the values y of the function /, the functions / and g 
are differentiate and the derivative g f is continuous. 
The following formula gives the derivative of the com- 
posite function #[/(#)] in terms of the derivatives /' and g'. 



= . 
dx dy dx ? " ( j x dy y ^ 1(x} dx 

Given x and h ^ 0, let us write k = f(x + h) f(x) 9 
i.e. 1(x + U) =y + k. 

Applying the formula (11) on the mean-value to the 
function g we obtain: 






To get Formula 1 we have to pass to the limit 
as fe tends to 0. Now, by virtue of the continuity of 
the function g we have lim& = 0. kSince < < 1, this 

ft=0 

also implies Km 0k = (let us note that 9 is also a func- 

fc-o 

tion of the variable h). Thus lim(j/+ 0fc) = ?/, which 



( l ) For brevity, we write gf(x) instead of 
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gives liniflf'(// + 9k) = g'(y) = #'[/(#)] according to the 

fc-O 

continuity of the function </'. Consequently, 



.. 

dx ft^.o 'I 



= ttmg'(y + 0fc)lim ^ = j,' [/(*)] f(x) . 

/l=0 /i=0 / 

K em ark. The theorem is also true without the as- 
sumption of the continuity of the function y'. However, 
then it requires another more complicated proof. 

Applications. Formula 1 enables us to generalize 
Formula 7 of 7.2 in the following way: for any real a 
and any positive #, we have 



Samely, we have x" = e^ loex and so substituting 
z = e y and y = a- logo 1 we find 



dialog JT>) a a 

= _. .-A_-J ^ cv._ ^ ^.- = a- z*- 1 . 
ax ay dx x x 

The above calculation could be written also in the 
following way: 

d*0* . _ 0." = a . ,^-i. 

,r rr 



for 

^ >a: _ d<P l ** x <i^ lo x d(^- log.r) 
ctr "" dx ~~ d(x-logx) dx 



Let us note that formula 2 of 7.3, ^ 

proved previously, could be proved in an analogous way, 
because a x = 
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In practice we sometimes apply Formula 1 several 
times; e.g. if y = /(#), z = g(y), w = h(z), we calculate 



i * - x- i 

the derivative t > applying the equality: 

(toe 

dw dw dz dy 
dx dz dy dx' 

As seen, the derivatives in the above formula behave 
like ordinary fractions. 
4. dlogf(x) ^f(x) 
dx f(x) ' 

This expression is called the logarithmic derivative of 
the function /. A knowledge of the logarithmic derivative 
gives the usual derivative at once. This is easy to show 
by considering the example of the function y = aP (where 
the logy xlogx is differentiated). 

EXAMPLES. 

dx? 



dx ~ 



cos(,r 2 )2# = 2x 

((3) The derivatives of the hyperbolic functions. By the 
hyperbolic sine and cosine we understand the functions 

(15) sinh# ~ and cosher = 

2. * 

To find their derivatives let us note that 
de~ x ___ de~ x d(x) 



dx d(~x) dx 
Hence we find easily: 



___ 



/^v dsinha? _ . . 

(16) = - = cosh^ , - r - = smho? . 

v ' dx ' dx 

Now let us write 

Mr . v 
(17) 



cosh ,7? 
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Since, as it is easily seen, 
(18) eosh 2 # sinlAr = 1 , 

we have 

.sinho; 



(19) 



dtanha? 



d 



cosh# cosh 2 #-- sinh 2 # 



1 



dx dx 

The functions sihha? and cosh# have inverse functions. 



Namely, let y = 






. Then e?~ e~ x 2y = 0, i.e. e 2 * 



^1 0, whence 

^ =- // + I'^+l , i.e. x -- log (y + } 'y* 




FIG. 14 



FIG. 15 



FIG. 16 



(the A^alue y yy^+l being negative, we do not take.it 
into account). In this way we have expressed x as a func- 
tion of y. This is the required function inverse to sinh#. 
We denote this function by the symbol arsinh: 



(20) 



arsinh a? = 



Similarly, we find the function inverse to cosh a? 
(x ^ 0). This function is denoted by the symbol arcosh. 
We find 



(21) 



arcosh x log (x + )/x 2 l) , x ^ 1 . 
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Analogously, a function inverse to cosh a? (x < 0) is 

log \X J/ X" _LJ } X ^- \ 

Applying the formulae (16) and the formula on the 
derivative of the inverse function we find easily that 



/rtftx 

(22) 



,.. rt , 

(23) 



darsinho? 

-- - - 

dx 

darcosha? 

- - -- 

dx 



d 



1 d 1 / - 

,-^-r - log afi I .^ 2 - 
ic 2 1 d^ 



This calculation may be performed also by differ- 
entiation of functions on the right sides of the formulae (22) 
and (23). 



FIG. 17 



FIG. 18 



FIG. 19 



We add that the following formula is found for the 
function inverse to tanho?: 



(24) 
Hence 

(25) 



+ 1 i 

ar taring = - log 



3 



fartanh,T 
dx 



- = i- 
a? dx\2 



Bemark. The formulae on the differentiation of the 
fundamental functions with which we became acquainted 
in 7.2 and 7.3 together with the formula for the dif- 
ferentiation of composite functions make it possible for 
us to differentiate an arbitrary elementary function (that 
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is a function obtained from the fundamental functions 
by applying of an arbitrary number of compositions). 
A derivative of an elementary function is itself an ele- 
mentary function. 

Now let us consider the following function (non- 
elementary): 

(26) f(jr) = .T 2 - sin for ;/ /: , /(O) = . 

The general formulae for the differentiation of the 
elementary functions do not enable us to calculate /'(O). 
We must calculate this derivative directly from the 
definition of a derivative. 

We have 



It is clear that- for .r ^ the derivative /'('') may be 
calculated by means of general formulae concerning the 
differentiation of the elementary functions. 

7.7. Geometrical interpretation of the sign of a derivative 

Lagrange's theorem enables us to establish the relation 
between the sign of the derivative and the increase or 
decrease of the function. 

1. // the inequality f'(r) > holds for any x belonging 
to an interval ab, then the junction f is increasing in this 
interval. 

^1 f'(' r ) < O everywhere, then the junction is decreasing. 

According to the formula (tl) we have for li > 0, 
j(x-\-li) > f(x) or /(.*-+ //) < /(.^), depending on whether we 
assume the derivative to be positive or negative every- 
where. In the first case the function / increases and in 
the second one, decreases. 

Remark. Assuming f(x) > or /'(#) ^ everywhere, 
the function / is increasing in the wider sense or de- 
creasing in the wider sense, respectively. 

11 
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The following theorem is the converse to Theorem 1: 

2. If a function f is differentiate at a point c and 
increases (or decreases) in a certain interval surrounding 
this point, then f'(c) > (or f'(c) < 0). 

Namely, if / increases, then for h > we have f(c 



f(c)> and so ^_ > o an d passing to the 

fi 

limit we obtain f'(c) > 0. 

Similar arguments can be applied in the case in which 
the function / decreases. 

We conclude from Theorem 1 that 

3. // f'(c) > 0, then the function f is increasing in 
a certain neighbourhood of the point c (assuming the de- 
rivative to be continuous at the point c). 

Similarly: if f'(c) < ? then the function is locally 
decreasing at the point c. 

Indeed, because of the continuity of the function 
/' the inequality f'(c) > implies the existence of 
a number 6>Q such that there holds f(c + h)>0 for 
\h\<6. This means that the derivative /'(#) is positive 
at any point of the interval c h<x<c + h. Thus, ac- 
cording to Theorem 1 the function / is increasing in this 
interval. 

Bern ark. Theorem 3 may be expressed in the follow- 
ing way: if f'(c) ^ 0, then (assuming the continuity of 
the derivative) the function / is locally one-to-one at 
the point c, i.e. it is one-to-one in a certain interval 
c~d <x<c + d (d> Q). Thus, the function y = /(#) 
possesses the inverse function %~g(y) in this interval. 
As we already know, the derivative of this inverse func- 
tion is equal to the inversion of the derivative of the 
function /. 

By the above assumptions we see that for a given 
value of y the equation y = /(#) possesses one and only 
one solution for x belonging to the interval c <5, c + d. 
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e x 

EXAMPLE. The function y = decreases for x < 1 

JC 

and increases for x > 1. 
Indeed, 

e x (xl) 



^L l^\ - x ^ ~~ x 

dx\x) x 2 



This expression is <0 if x< 1 and >0 if x > 1. 

Hence it follows that lim -'- = CXD. Indeed, lim = co 

(cf. 3.5, 7) and so the function , being unbounded 

and increasing, tends to CXD as x tends to CXD (we have 
obtained this result in another way in 4.6, ((3)). 

More generally, we prove in a completely analogous 
way that the function f(x) = e x x a (x> 0) is decreasing 
for x < a (and a < 0) and increasing for x > a and, 
since lim e n n a oo (cf. 3.5, 7), 

rc=co 

7.8. Indeterminate expressions 

Gauchy's theorem in 7.5 makes it possible to cal- 
culate the limit of the following form: 



(28) lim ? W here /(a) = - 



Expressions of this kind are called "indeterminate 
expressions of the type |J ". 

1. // the functions f and g are continuous in the closed 
Interval a < x < b and are differentiate inside this interval 
and if f(a) ~ = #(&), then 



(29) lim = i im 



assuming the existence of the last limit. 
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Let us write 1 x a + h. Then it has to be proved that 



(30) i im 

* --10 </ < h HO 

Now, the equations f(a) = //(a) and the Cauchy 
formula give 

f(a |- A) ^ /( + /0_- 
-/0~ </( :| /0-f 



Since lira <9A =- + 0, we have 

//-^ 



whence the formula (30) follows. 

A similar theorem concerns the left-side limit. 

When the derivatives /' and //' an* continuous at the 
points a and y'(a) ^ ^? formula (29) implies immediately 
the following de 1'Hospital ( ! ) formula: 

(31) 

-r-fl y\+'l <J V*l 

A similar formula concerns the one-side limit and the 
one-side derivatives. 

EXAMPLES, (a) To find iim -'-- let us write 

f(x) = log(l + ,r) and <J(JT) = x . 
Hence 

/\ 

and so 
(32) 



X 



( 2 ) De 1' Hospital, a French mathematician of the second half 
of the 17th century, known especially for popularizing the dif- 
ferential calculus. 
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ft _ 

(P) Evaluate lim -- . Let us write f(x) = e?\ and 

jc=o 

<f(x)-^x. Then we have /(()) = - </(0), /'(,&) = *, 
</'(,/) =^ 1 . Hence 

(33) lim^-U OT = 1 . 

V ' .,_o '< </(0) 

Remarks, (a) If tj'(a) - but /' (a) ^ 0, then the 
formula (31) gives lmi^-|- - 0. But if /'() = = flf'(), 



then the formula (3.1) cannot be applied. In this case 
the derivatives of higher orders have to be applied. 

(Cf. 8.4.) 

(ft) The formula (21)) may be applied also in the case 
when a =- oo. In other words, if lim f(x) ~ lim g(x) 9 

r ix) ^c---oo 

then 



assuming the existence of the last limit. 

We write ,r and define, an auxiliary function F(t) 
t 

by the conditions: /''(O =/(-)) for t /- and ^( ( >) = 0. 



Similarly, let G(t) -- g\\ for ^ and (0) = 0. The 



function ^ 7 is continuous at any /- as a composition 

of two continuous functions: and /. it is also right-side 

t 

continuous at the point 0, since (cf. 4, (18)) 



lim F(t) = \m\f =lim/(a?) -0 = * 1 (0). 

^= + t= I \t/ J--OG 

Similarly, the function (i is continuous. To be able 

W(t) 
to apply the formula (21)), lim -,-J- has to be calculated. 

t=-\ o CT (t) 
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'Now, we have 



_ _ 
"<ft" "~"dF~" clx 

for J^O. Similarly, #(<) = -'7- Thus 

= lira 



Besides indeterminate expressions of the form -- , in- 
determinate expressions of the form are also con- 

00 

sidered. By such an expression we understand 

where lim /(a?) = oo = Yimg(x) . 



Sometimes the calculation of indeterminate expressions 
of this form may be reduced to the form - . For, writing 

Fix) -7-77 and O(x) = - , we have 



r .. 

lim -~{ = lim 



and this last indeterminate expression is of the form - . 
Similarly, if lim/(#) = and lim</(j?) = oo, then the 

ar=a ar-a 

indeterminate expression \imf(x)'f/(x) of the form O-oo 

x**a 

may be reduced to the form -, for 



</(*)= li 
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If lim /(a?) = oo = lim g(x], then we reduce the in- 

x*=a x***a 

determinate expression lim[f (x) g (x)] of the form oo oo 

x=a 

also to the form - , writing 



It remains to consider indeterminate expressions of 
the form 0, 00 and 1. They may be reduced to the 
above considered by means of the relations 



EXAMPLES. 

,. - -logcosrr ^ m ---= 

(y) lim (costf)*- lim 6* = e x ~ +QX =1, 

because 

log cos a? r (log cos x)' ,. tan x 



= . 

x~- fO ^ ^^ +0 ,7? ^=+0 1 

(S) Find the right-side derivative /^(O) of the func- 
tion / defined as follows: f(x) = a^ when o?> 0, /(O) = 1. 
We have 



r - r 

= lim - y 7 v ' = lim 



This is an expression of the form - , for lim of* = 1 
( 5.3). Applying formula (29) and taking into account 

the fact that -=- (#* 1) = #*(logo? +1) (cf . 7.6, 3) we obtain 
dx 

lim = lim = , 

wX ___ "t /r f*E(\C\CF W 1 ~\\ 

ajiBM-j-Q*^ * iC^+O*^ v 1 "^*^ "i - 1 -/ 

whence /+(0) ~ oo . 
(e) The expression lim (xiogx) is an indeterminate form 

of the type oo. The proof that this limit is equal to 
may be derived directly, without applying of the dif- 
ferential calculus (cf. 4.6, (8)). 
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7.9. The derivative of a limit 

THEOREM. // tlie equalities 

(35) lim f tl (jc) - / (x) and Mm fa(x) = g (x) 

??,=oo ?< = oo 

are satisfied in the interval a -; x <, b, the functions f' tl being 
continuous and uniformly convergent to <y, then 

(36) f'(x) - g(r) , 'i.e. f lim / n (.r) 



Let c be a given point of the interval ab. Let us 
estimate the difference 

(37) ><f + *]-''< c )- i ,(o) =f.(c + e*)-^) . 

Let e > be given. Since the sequence {f' n } is uniformly 
convergent to */, there exists a 7c such that 

(38) i/;c*)-ff(.*oi<* 

for n > k and for any x belonging to the interval ab. 

The function g being continuous as the limit of a uni- 
formly convergent sequence of continuous functions 
(cf. 6.1, 1), a number e > exists such that the in- 
equality \x c\ < (5 implies 

(39) |sfW)-flf(<0|<e. 

Thus, assuming n > k iand \li\ < 6 we obtain the 
following estimate: 



i.e., by (37), 



.l^M'Urtc) 



Since 
lim f n (c + A) = /(c + h) and lim / n (o) = /(c) , 
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we have 



i A * M 

if only |A| < 6. Passing to the limit as A tends to we 
therefore obtain equation (36). 

Eemarks. (a) Even the uniform convergence of a se- 
quence of functions does not imply the convergence of 
the sequence of derivatives, as is shown by the following 
example: 



(p) The theorem remains true if we assume that the 
first of the equations (35) is satisfied at a given point v 
instead of assuming it to be satisfied in the whole in- 
terval ab. For, if the sequence of functions is convergent 
at a point c and if the sequence of the derivatives is 
uniformly convergent in the whole interval ab, then the 
sequence of functions is convergent in the whole in- 
terval ab. 

Indeed, according to our assumptions, to a prescribed 
e > there exists a number k such that the inequalities 

(40) | f n (v) - f k (c) | < K and | f' n (x) - f' k (x) \ < e 

are satisfied for n > k and a <; x < b. 

Let us write F n (x) = f n (x) fk(x) and .r=-}-h. Then 
we have 

.F' t) (c \ 0/0 
) - f k (c) + h[f u (c 



Hence, by (40), we have \F n (v)\ <e + (b a)e = 8 (1 -\-b a). 
Thus the sequence / rt (j?) is convergent. 

7.10. The derivative of a power series 

We shall prove that 

(41) - 
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for any x lying within the interval of convergence of the series 

(42) i(x) = 
Moreover, the series (42) and 

(43) g(x) = a 1 



have the same radius of convergence. 

We shall first prove the second part of the theorem. 
Let r be the radius of convergence of the series (42) and 
let < c < r. We shall prove the series g(c) to be con- 
vergent. Let c < C < r. Let us compare the terms of 
the series 

(44) \a 1 \ + 2\a 2 \c + ... + n\a n \c n n + ... 

with the corresponding terms of the convergent series 
(cf. 6.3, Theorem 1): 

(45) | % |C + |a 2 |<7 2 + ...+ a n \C n + ... 

Since lim \/n 1 (cf. 3.5, 8) and > 1, we have 



,-' C 
I- < - 



and thus 



for large n. 

Hence we conclude that the series (44) is convergent 
and so the series g(c) is absolutely convergent, too. 

Conversely, if the series (43) is absolutely convergent, 
then the series (42) is also convergent. Namely, 

\a n cc^\ = \x\- \a n x n ~ l \ < \x\- \na n x n ~ l \ . 

In this way we have proved that any point lying 
within the interval of convergence of the series (42) 
belongs to the interval of convergence of the series (43) 
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and conversely: any point lying within the interval of 
convergence of the series (43) belongs to the interval of 
convergence of the series (42). Thus, both these intervals 
are equal. 

Now, let us proceed to the proof of formula (41). 
Let x be an interior point of the interval of convergence 
of the series (42) and thus of the series (43), too. Let 
the interval ab be any closed interval surrounding this 
point and lying inside the interval of convergence. By 
Theorem 1 of 6.3 the series (43) is uniformly con- 
vergent in the interval ab. This means that when we write 

the functions f n constitute a sequence uniformly con- 
vergent to the function g in the interval ab. Applying 
the theorem of the previous section we obtain the for- 
mula (41). 

As is easily seen, formula (41) states that a power 
series can be differentiated, term by term, like a polynomial. 

oo 

More generally, if by differentiating the series u n (x) 

n-O 

00 

term by term we obtain the series u' n (x) uniformly 

convergent and if, moreover, the functions u' n (x) are 
continuous, then 

00 00 

(46) -_- N u n (%) / u' n (x] . 

71 = 71 = 

EXAMPLE. Differentiating the series 

_JL -1 

T^x ~ 

we obtain for \x < 1: 

_L_=14 

(1-X)* 
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7.11. The expansion of the functions log(l + x) and arc tan # 
in power series 

Let us consider the known formula 
(47) 
It is obvious that the series appearing in this formula is 

j$ jA jA ,.5 

the derivative of the series ti(x) x - + *--- -- + '-- r ... 

Hence the functions iog(1-fj?) and 8(x) have the same 
derivative and so they differ only by a constant (cf . 7.5, 4). 
Let us write log(l + ,r) = H(x) + C. The constant C may 
be calculated by substituting x = 0; we obtain log(L + 0) 
= = AS y (0). Hence C = log(l + 0)-tf(0) - 0. 

So we have proved the functions log(l +x) and S(x) 
to be identical in the interval !<#<!. Speaking 
otherwise: 

(-18) log(l + *) =x- J ?+*-* + ... (M < 1) . 

Similarly, we deduce from the formula 
d arc tan x 1 



- 
5 



that 

j^3 

arc tan x = C + x -~ 



Substituting x and taking into account that 
arctanO = 0, we obtain C = 0. Consequently, 

/v>3 >i5 -v7 

(49) arc tan# = jj + ~ ~ + ... ( \x\ < 1) . 
t.j > < 

Thus, we have proved that the formula (48) holds 
for \x\ < 1. We shall show that it holds also for x = 1. 
Indeed, for x 1 the series on the right side of this 
formula, i.e. the series $(1) == 1 J+ J ..., is convergent 
and thus by the Abel theorem ( 6.3, 3) the function 
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is left-side continuous at the point 1. Hence 

8(1) = lim >S'(,r) -, lim log(l + #) =. log 2 , 

J--1-0 ./--1-0 

since the function log(l + ,r) is continuous at the point 1. 
Consequently, 

(50) Iog2- 1-i i i 1 + 1-... 

Similarly, we deduce from formula (49) the Leibniz 
formula: 

(si) 4"" 1 ' 3 + 5- ^ + J " 

Denoting the right side of the equation (49) by T(x] 
we have 

T(l) lim 7 ! (.r) lirn arc tan, r arc. tan .1 ' - , 

whence formula (51) follows. 

Remarks, (a) Tn practice the Leibniz formula is not 
convenient for the calculation of the number TT; e.g. to 
calculate the first three decimals of the number rc/4 it 
would be necessary to take the sum of the first 500 terms 
of the Leibniz expansion. Much more 1 convenient is the 
following formula. 

Let a =- arc tan i, (i arc tan , i. e. tana = J, tan/5 
= i. Since 



and 1 = arc tan (it/4), so Ti/4 = a + ft =- arc tan J + arc tan J. 
Hence, by formula (49), we obtain: 

W -:L_ ! i. JL i ! - 1 i - l -_ 

4 " 2 3 - 8 r 5 - 32 "* r 3 3-27 5 . 243 '" 

Other formulae giving even faster methods for the 
calculation of TT are known. 

(P) The formula (48) leads to the following inequality: 

(52) - log( 1 + x) < 1 for < x < 1 . 
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For, we have 
(53) ilog( 1 + a :)= 1 -| + f-...^T... 

For < # < 1 this is an alternating series satisfying 
the conditions 

x 2 ofi _ x n 

!>> >... and Inn = : 

2 3 nse=0 o n ' 

thus, according to the theorem 3.3, the sum of this 
series is less than its first term, i. e. the inequality (52) 
holds. 

Similarly we prove that 



(54) + iog(l+0)>l for 0<a?<l, 

since adding to the series (53) the series (48) divided 
by 2, we obtain 



It is easily seen that by omitting the first term we obtain 
an alternating series satisfying the assumptions of Theo- 
rem 1 of 3.3. Hence we conclude that the sum of this 
series is positive. Thus, formula (54) holds. 

7.12*. Asymptotes 

By applying the differential calculus it is possible to 
find the asymptotes of a given curve y = /(a?). The straight 
line Y aX-\-b is called an asymptote of the curve 

y =/(*), ^ 

a = lim f(x) and b = lim \j(x) ax\ ; 



hence it is seen that the direction of an asymptote is 
a limiting direction to which the direction of the tangent 
to the curve at the point [>, /(#)] tends, as x tends to oo; 
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moreover, the distance between this point and the asymp- 
tote tends to 0, because this distance is equal to | [/(#) 
ax 6]cosa|, where a is the angle between the asymp- 
tote and the .X-axis. 

Similarly we consider asymptotes for x tending to oo. 

Finally, the straight line X = c (parallel to the Y-axis) 

is called an asymptote of the curve y f(x), x<c, if 

lim f'(x) == co = lim f(x). Similarly we define the 

x=c o a;=c 

asymptotes to the curve y =f(x), x> c. 



FIG. 20 



EXAMPLES. As it is easily seen, the asymptotes of the 
hyperbola y = 1/x are the axes X and Y. 

To find the asymptotes of the curve y = e~ llx , we 



calculate y' 



- 

X 



-. Hence lim y = 1 and lim y' = 0. Thus, 



a = and 6 = 1, and the straight line Y = 1 is an asymp- 

tote. A second asymptote is the Y-axis, because lim y -= oo 

#=-0' 
and lim y' = oo. 

z=-0 

7.13*. The concept of a differential 

A rigorous mathematical sense may be given to the 
concept of a differential in the following way. By the 
differential of a function y = f(x) at a point x with 
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regard to the increment h we understand the product 
f(x)h. We write 

(55) df(x) = f'(x)h or, more briefly, dyf(x)h. 

The symbol df(x) or dy, convenient in applications for 
its simplicity, takes into account neither the dependence 
of the differential on the variable x with respect to which 
the differentiation is performed, nor the dependence on 
the increment h. To satisfy these requirements we should 
have to write e.g. d x (y, h). Moreover, if we should like 
to point out that the differential is considered at a point # , 
we should have to write [Y7 r (/(j?), h) J r ^r l )V analogy with 
the notation for the derivative at a point .r . 

By formula (55), dx = A, for substituting f(x) x 
we have f'(x) 1. 

Thus we may substitute in the formula (55) li dx. 
We obtain dy = f'(x)dx. Dividing both sides of this 
equation by dx we have then 



where the right side is the quotient of two differentials 
(which may be considered as an explanation of the 
Leibniz notation for the derivatives). Speaking more 

strictly, we have f(x) - ^ ( / /? ?J for every ft ^ 0. The 

d x (x, h) 

formulae of the differential calculus may be written in 
the differential notation as is seen by the following 
examples: 

dsinx = co8#&r , dc = . 



Formula 4 of 7.4 for the derivative of a sum leads 
to an analogous formula for the differential of a sum: 



(56) d(y + ff) 

Indeed, let y =/(#), z = g(x). We have 
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Analogously, we prove that 
(57) d(yz) = ydz + zdy . 

Now we shall give the formula for the differential 
of a composition of functions. 

Let y = f(oo) and z = g (y). Then 

dof(x) 

Namely, d x z = -ij-dx - g'(y)1'(x)dx = g'(y)d x y, ac- 
cording to (55). 




x+h 



Let us note that by (55) we have also d y z = (j'(y)d v y. 
Comparing this equation with equation (58) we see that 
if z is a function of the variable y, then the formula for 
the differential z remains formally unchanged after re- 
presenting y as a function of a new variable x (however, 
the index at d showing with respect to which variable 
one has to differentiate has to be obviously omitted). 

The geometrical interpretation of the differential is 
immediately seen in Fig. 21. 

The following theorem holds: The difference between 
the increment of the function Ay = f(x + h) f(x) and the 

12 
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differential dy, divided by the differential dx tends to 
together with this differential, i.e. 



(59) lim ^=-^ = . 

dx0 (*& 

Namely, 



da? 
and 



In practice (e.g. in physical applications) the above 
theorem often makes it possible to replace the differential 
dy by the increment Ay. 

Exercises on 7 

1. Differentiate the following functions: 



4) sec a? , 5) co sec x , 6) cotano? , 

7) arc see a; , 8) arccoseco?, 9) arccotan^, 

10) log sin a; 9 11) log tan x , 12) arccos(l x) , 

^y 1 8 

13) arc tan- - 2 , 14) logsinh^, 15) artanh|/iP. 

JL *H7 

2. Prove that if a function / is differentiate, then 
its derivative /' possesses the Darboux property (i.e. passes 
from one value to another through all the intermediate 
values). 

(First prove that if f(a) < < /'(&), then a point c 
exists in the interval ab such that f(c) = 0. The general 
case when f'(a) < A < f'(b) may be easily reduced to the 
previous one considering the function f(x) Ax.) 
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vi Ix n X n + l \ 

3. Given the series f(x) = 2i I --- rl 

w =i \ % n-}-/ 
and the sum of the series of the derivatives. Compare 

the result obtained with the theorem in 7.9. 

4. Prove that if a function / is differentiate at 
a point x, then 

in v 
f(x) - 



8how by an example that the converse relation does 
not hold: the above limit (i.e. the so called generalized, 
derivative) may exist although the function is not dif- 
ferentiable at the point x. 

5. Give an example of a function having a generalized 
derivative at a point of discontinuity. 

6. Give an example of an even function (i. e. such 
that f(x) - f(-x)) for which /'(O) = 0, although the func- 
tion does not possess an extremum (even an improper) 
at the point 0. 

7. Prove that if a differentiate function possesses 
maxima at the points a and ft, then it possesses also 
a minimum at a certain point between a and b. 

8. Let a function / be continuous in an interval 
a < x < b and differentiable inside this interval. If the 
right-side limit lim f(x) exists, then the right-side de- 

x<=a+o 

rivative of the function / exists, too, and they are both 
equal: l+(a) lim f'(x). 

x=a+0 

9. Prove that among all rectangles with the same 
perimeter the square has the greatest area. 

10. Prove that among all triangles with a constant 
perimeter and with a constant base the isosceles triangle 
has the greatest area. 

11. Prove that among all triangles with a constant 
perimeter the equilateral triangle has the greatest area. 

12. Prove that if the derivative /' is strictly monotone, 
then for any x the curve y = f(x) lies on one side of 
the tangent at this point. 
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Hence conclude that eP s >I + x for x ^ 0. 



13. Prove that (- + ^)log(l +x) < 1 for < x < 1. 

\X O/ 

/Y 

14. Prove that <:log(l + #) <# for x> 1. 

" 



15. Expand log 1 / - --- - in a power series. 

W JL t)u 

16. Given two points P and (> lying on the plane 
above the J-axis, find a point R on the X-axis such 
that the sum of the segments PR and RQ is the shortest 
possible. Prove that the (acute) angles between these 
segments and the X-axis are equal. 

(Interpret this result in the theory of optics: PRQ 
the path of the ray, the ^Y-axis = the mirror). 

-^ i , ,. tana? ,. /TU \, .. x - 

17. Evaluate hm- . lira | s x )tan#, hm i x. 

' ' * 



18. Prove the existence of the limit (called the Euler 
constant}: 



... - 

& o n 

(prove that the considered sequence is decreasing and 
bounded, applying the inequality from Exercise 11). 

19. Prove that if the differentiate functions / and g 
satisfy the inequality f(x)g(x) ^ <)'(rff(%) for every x, 
then between any two roots of the equation f(oo) = 
there exists a root of the equation g(x) = 0. (Consider 

i(x] 
the auxiliary function --; rO 



8. DERIVATIVES OF HIGHER ORDERS 

8.1. Definition and examples 

The derivative of the derivative of a function / is 
called the second derivative of this function. Similarly, 
the third derivative is the derivative of the second de- 
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rivative. Generally, the n-th derivative is the derivative 
of the (n l)-th derivative. We denote the derivatives of 
higher orders by expressions of the kind: 

r iff ,, AH) m , dy d*y cfy cTy 

i 9 I ? / ? ? / ? Ol ~' Tl* T~3 >*> T~n> " 

ax ax ax ax 

So we have 



E.g. let f(x) = a?. We have /'(#) = 3^ 2 , /"(a?) - 60?, 
/"'(/E) ^ 6 and /<*>(#) = for w- > 3. More generally, 

fl k (r n \ 
(1) C _1^_J = w^-lJ-.-.-^-fc+l)^-* for kt^n, 



dx n 

If a is a real number (but not a positive integer), 
then we have 



(2) 

for an arbitrary positive integer fc and for an arbitrary 
x>~l. 

The function e x has the property that its derivatives 
of all orders are identical with itself. 

Taking /(#) = sin a? we have 

(3) /'(#) = coso? , f er (x) sino? , 

/'"(#) = coso? , / IV (^) = sin a? . 



Here the equation /< n >(#) = /< w+4 >(a?) holds. The same 
equation is satisfied by the function f(x) cos a?. 

Let us note by the way that it is convenient to con- 
sider the derivative of order as equal to the function 
/>)(#) = f(x). The above given equation holds also for 
n = 0. 

The formula (1) makes it possible to calculate easily 
the ft-th derivative of a polynomial of degree n: /(#) = 
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. Substituting x = in / (fc >(#) (for 
Jc = 0, 1, ..., n) we find: 



Hence we obtain the formula 

/y*2 s^n 

(5) 1(X) - 



which we shall generalize below. 

As an example of the calculation of derivatives of 
higher orders let us mention the formula for the second 
derivative of the inverse function. 

A dx dy ^ T 

As we know, ^- = 1 : -- . Hence 
dy dx 



d*x \ dx) dx ^ dx 2 dx 
dy 2 ~ dx dy ~ IdyV dy ? 



i.e. 



dy* dx 2 ' \dx, 

In applications in physics the second derivative is 
often of importance. In particular, the acceleration of 
a particle as a derivative of the velocity with respect to 
the time is the second derivative of the distance covered 

with respect to the time, i.e. -^ . Hence the force acting on 

the particle is equal to m -j-^ , where m denotes the 
mass of the particle. 

8.2*. Differentials of higher order 

We define the second differential of a function / 
as the differential of the differential of the function /. 
Speaking more strictly, we define it as the differential 
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with respect to the increment ft of the differential of 
the function / with respect to the increment ft; the variable 
with respect to which the differentiation is performed is x. 
Then, writing y = f(x) and denoting the second dif- 
ferential by d 2 y we have 

<Py - d(dy) = d(y'h) - ^(y'&)& = y"W - y"(dx)*. 

Hence we see that the second derivative of a function / 
is the quotient of its second differential over the square 
of the differential dx (which ^explains the notation of 
the second derivative). 

Generally, the n-ih differential d n y is defined as the 
tt-th iteration of the differential, i.e. <Tt/ = d(d?~ l y) (with 
respect to the same increment ft). 

Then we have 

(6) tfy=y (n \dx) n . 

We prove this by induction. Formula (6) holds for 
n 1 (and as we have seen for n = 2, too). Assuming this 
formula for n, it has to be proved for w+1. Now, 

d n+l y - d(d n y) = d[y (n \dx) n ] ^^-[y ( 



EXAMPLE. The derivatives of higher orders of the 
inverse function (cf. the previous section) may be cal- 
culated by means of differentials of higher orders as 
follows. Let the function x g(y) be inverse to y ~ /(#). 
The differentials dy, d*y, d*y etc. will be understood as 
d y y, dly, dly etc. Evidently, d 2 y = 0, d*y = 0, ... 

Since y'x' 1, we have dy y'x'dy. Differentiating 
with respect to y, we obtain 



(/7i/' /7r 
^ Ty' ' 
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Similarly, 

= d*y = [y'"(x')* + 3y"x'x" + y'x 

In this way we obtain equations which make it 
possible for us to calculate the derivatives x', x", #'", ... ? 
successively: 

y'x' - 1 , 



y " f (x')* + 3y"x'x" + y'x'" = , 

8.3. Arithmetical operations 

Let y = j(x), z = g(x). We verify easily by induction 
that 

and 

For the n-th derivative of a product, the following 
Leibniz formula holds: 

(9) 



We shall prove this formula by induction. For n 1, 
we know this formula as the formula for the derivative 
of a product. Let us assume this formula to hold for n 
and let us differentiate it. We obtain 
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since 

(*\ + / \-/ n+1 \ 
\fc/ + \*-i] - \ * ; 

(cf. 1, (4)). 

EXAMPLE. To find the n-th derivative of the function 
xe?, let us write y = e* and 2? ,7?. As is easily seen, only 
the two first terms do not vanish in the formula (9). Hence 

d n 
- (xe?) = e%T + w) . 

dx 

8.4. Taylor formula C) 

The Lagrange formula ( 7, (11)) is the "first ap- 
proximation" of the following Taylor formula: 

Let us assume the function f to be n times differentiate 
in an interval a < x < b. Let us write h = b a. Then 
f(b) may be represented in the following form: 



(10) 

+ ( b ~ a ) n ~ l f n ~ l \ a \ + ft 

where 

where and &' are suitably chosen numbers satisfying 
the inequalities < < 1 and < &' < 1. 

Proof. According to equality (10), we have 






( x ) Brook Taylor and Colin Maclaurin (cited in the following), 
respectively English and Scottish mathematicians of the first half 
of the 18th century. 



186 III. DIFFERENTIAL CALCULUS 

Let us denote by g n (x) an auxiliary function obtained 
from B n by replacing a by x, i.e. 

(13) g n (x) = /(&)_/(o>)- 



Differentiating we obtain 



Thus, flf;(a?) - -TT-rr/^V)- At the same time 

&)=0, flf n () -.Bn. 

Applying the mean-value theorem, we obtain 



i.e. 



(-!)! 



whence 



according to the second part of formula (11); this is 
the so called Cauchy-form of the remainder. 

To prove the first part of formula (11), i.e. the 
Lagrange formula for the remainder, we shall apply to 
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the functions g n (x) and u n (x) = (b~x) n the Cauchy theo- 
rem ( 7.5, 5). We obtain 



Taking into account the equations u n (b) = 0, u n (a) = h n 
and u' n (x) = n(b x) n ~ l we conclude that 

-R n _ ( b -a-0h) n - l . n) ^ 



~n n (n-l)l 

whence the remainder R n is obtained in the Lagrange-forni. 

Thus, the Taylor theorem is proved completely. 

Substituting b = x and a = 0, we obtain the Mac- 
laurin formula: 

/v /yfl~~l . . 

(14) i(x) = /(O) + 11 /'(O) + ... + - ( jy, /'"-"(O) + , 
where 

(15) R n - ^i f n \0x) = ^ ^""^ f n \0'x) . 
; w! (n 1)! 

The above formula is satisfied assuming the function / 
to be n times differentiable in the closed interval 0# 
or #0, according as to whether x > or x < 0. (As is easily 
seen from the proof, the assumption of the n times diffe- 
rentiability of the function may be replaced by a weaker 
assumption, namely, it is sufficient to assume that the 
(n l)-th derivative is continuous in the whole interval 
and that the w-th. derivative exists inside the interval; 
these are the assumptions which we have made for n = 1 
in Kolle theorem). 

EXAMPLES AND APPLICATIONS, (a) Let us apply the 
Maclaurin formula substituting f(x) = e^ and n = 2 in 
formula (14). Since 

f(x) =e?^ f"(x) and /(O) - 1 - /'(O) , 
we have 

e x = 
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Hence we conclude that for any x the inequality 
(16) e*^l + x 

holds, because x 2 > and e &x > 0. 

Inequality (16) possesses a clear geometrical content 
on the graphs of the functions y = e x and y = 1 + x. 

(P) The Taylor formula makes it possible to sharpen 
the de 1'Hospital formula (7, (31)) as follows: if the 
functions / and g possess continuous n-th derivatives and if 

/(a) - , f(a) - , ... , /<-D(a) - , 
(j(a) - , g'(a) = , ... , 9 (n ' l) (a) - , but g^(a) ^ , 
then 

(17) 

V ' 



Indeed, according to our assumptions and the Taylor 
formula (10) (with b replaced by #), we obtain 



and 



Thus, 

/_(#[ _ fM[a+6(x a)] 

~g(xj ~~ ffi[a+S'(p-a)} ' 

Passing to the limit for x tending to a and basing 
on the continuity of the functions / (n > and # (n) , we obtain 
formula (17). 

For example to calculate lim^ -. -, we write 1(x) = 

x~o xsmx 



= # sin x and g(x) ^sino?. Thus we have 
/(O) =0-0(0), r(a?)-l-cosa?, 

g'(x) =-- sin o? + a? cos a? , 
/'(O) - = </'(0) , na?) 



= , </"(0) = 2 . 
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Applying formula (17) (for n = 2) we obtain 

M .. .T sina; 

*) lim : = - = . 

s=o a? sin a? 2 

Similarly we find 

(19) lim (cot a? -) = 0. 

ar=0 \ ay 

_, ,1 xcmxsi&x , 

For, cot a? = : and writing 

x #sma? 



f(x) = xcosxsmx and g(x) = a? sin a; 

we obtain the required formula applying a calculation 
completely similar to the previous one. 

(Y) Applying the Maclaurin formula to the function 
f(x) = log(l + a?) and taking into account that 



w r e get 

for x > 1. 

In particular, we have, for x -- , 

n + l I 



oo -| 

Since the series ^ "i i convergent (cf. 3, (14)), the 

n-^l M 

series ^ I -- lg ----- ) is convergent, too. We denote the 

n-l u& '^' / 

sum of the last series by y. Thus we have 



. 
log--,- 

/ / 

v /, , 1 , ,1,23 
= hm 1+ - + ...M --- log T - s - 
n _>\ 2 & 1 2 
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But lim [log(w+l) logri] lim log - - = 0; conse- 

n oo n*=oo M 

quently, we obtain (cf. 7, Exercise 18): 
(20) y 

Approximately, the Euler constant y = 0,5772... ( l ). 

8.5. Expansions in power series 

We conclude immediately from the formula (12) that 
if lim E n = 0, then 



(21) 



w=0 



In particular, if we have lim B n = in the Maclaurin 

n=oo 

formula, then the function f(x) may be expanded in 
a power series: 

00 
rp ,y X ^ /v7l 

(22) j(x) =/(0)'+ I j/'(0) + | i /"(0) + ... = 2, J 



Before proceeding to applications of the above theo- 
rem we note that if all derivatives / (n) are uniformly 
bounded in the interval 0#, i.e. if a number M exists 
such that the inequality M > |/ (n) (@o?)| holds for each n 
and for any & satisfying the condition < < 1, then 
has the expansion (22) in a (Maclaurin) power series. 



For, \R n \ = 



nl 
we have also lim E n 0. 



x n 



x n 
M, and since lim r = 0, 

9 ' 



(*) Till now it is not known whether is a rational number 
or an irrational number. 

Leonhard Euler (1707-1783), a great Swiss mathematician; 
mathematics owes him, besides many new results, a systematic 
elaboration of the mathematical analysis of those times. 
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Eemarks. (a) The convergence of the series appear- 
ing on the right side of formula (22) is not a sufficient 
condition of equation (22), i.e. of the expansibility of 
the function f(x) in a power series. 

_- L 
For example the function f(co) e x2 (for x ^ 0), 

/(O) = 0, cannot be expanded in a power series although its 
Maclaurin series is convergent; we have here / (w) (0) = for 
each n. 

(p) Formula (4) may be generalized to a general 
power series. For, if / (x) = a + a^ x + a 2 oc? -f . . . , then 

a = /(O), a a = T- f -/'(0), and generally, 
/QQ\ a /W/fh 

\ & ij I ^fi i / \ " / 

nl 

In other words, if a function possesses an expansion 
in a power series, then it possesses only one such expan- 
sion, namely, the Maclaurin expansion (formula (22)). 

To prove this statement, we shall first prove by in- 
duction that the assumption 



implies 



Substituting in this formula x 0, we obtain equation (23). 
APPLICATIONS. 1. e? = 1 + + + ... = .. 



To prove this formula, we note that writing 
we have / (n >(#) = & and / (ri) (0) = 1. Moreover, the de- 
rivatives of all orders are uniformly bounded; for, if 
< x, then jM(Qx) < e? and if > x, then /< n >(6te) < 1. 

In particular: 1'. e= 1 + + ^ + ... 
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x x* a 



2 sin x - -- \- 

1! 3! 5! 

Applying formula (3) of 8.1 we conclude immedia- 
tely that the derivatives of all orders of the function 
sin are uniformly bounded (by the number 1) in the set 
of all real numbers. Moreover, /< n >(0) = sinO = for 
n = 0,2,4,... and /'(O) = 1, /' "(0) = -1, HO) - 1, ... 

Similarly, we prove that 

3. cos# = 1 ^ + j- f .- 

We shall deduce now the Newton binomial formula 
for arbitrary real exponents (which are not positive 
integers) and for \x\ < 1: 

00 / -J K / . -J v 

~ 2j ~~j n . 

7l-0 "' 

We shall consider the cases of x positive and of x 
negative, separately. 
1 x > 0. Since 

(cf. (2)), the remainder in the Lagrange-form is of the 
following form: 



n 



Since (cf. 3.4, 6) lim -- x n = 0> 

n=oo W>* 

for |a?| < 1, to prove that lim R n (%) = it suffices to show 

n=oo 

that for a given x the sequence (1 + Q n x) a ~~ n , n = , 1 , 2 , ..., 
is bounded. Now, according to the inequality x > we 
have 1< 1 + 9 n x < 1 + x. Thus, 1 < (1 + S n x} a < (1 



( x ) We add the index n to B in order to point out that 
depends on n. 
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or (l + #) a < (1+ O n x) a < 1 according as whether a ^ 
or a < 0. Moreover, (1 + 6 n x)~ n < 1. 

Hence the considered sequence is bounded. 

2 x < 0. Writing the remainder in the Cauchy-form, 
we have 



\n _L;. 
Just as before, we have 



it is to be proved that the sequence (1 0' n ) n ~~ l (I + 9' n x) a ~~ n 

(^ _ Q r \nl 
n ) and 
i + *y n x/ 

(l+0' n x) a ~ l are bounded. For this purpose we write 
y = x. Then y > and &' n > n y, whence 1 9' n < 

< 1 - 0' n y < 1. Thus, (^j$~ l < 1- 

On the other hand, 1 y < &' n y <~L and so 



or 1<(1 #;_ 

according as whether a 1 > or a 1 < 0. Thus, both 
sequences are bounded. Hence lim R n () = 0. 

n==oo 

EXAMPLES. Substituting a = we obtain 
/^ .1 1 , 1-3 . 



For a = ^ , we have 

1 _, 1 , 1-3 1-3-5 

. = 1 x-\ 



1/1 +i 2 2-4 2-4-6 

Hence 

i/flT^i ~ 2^ 2^1 2-4-6 



13 
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The above formula makes it possible to apply to the 
expansion of the function arc sin a? in a power series the 
same method which we have applied expanding the 
functions logx and arctan#. Namely, as is easily seen, 
the series appearing in this formula is the derivative of 
the series 

& 1-3 x 5 1-3-5 x 1 



But 

arc sin x = ; hence arc sin a? = S(x) + C . 
dx [/l x 2 

At the same time arc sin = = 8(0) and so (7 = 0, 

i. e. arc sin a? = 8(x). In this way we have the following 
formula: 

1 X s 1-3 x 5 1-3-5 # 7 , ,, _, 



We note that substituting x = i and taking into ac- 
count the fact that sin * n = i we obtain: 

H - _ _L 1 1 ll^ _JL 1-3-5 _1 

6 ~~ 2 2 '3 - 2 3 2 - 4 * 5^~2 5 + 2 - 4 - 6 ' 7~T 7 '" 

8.6. A criterion for extrema 

We have proved in 7.4, 2 that if a ( differentiate) 
function possesses an extremum at a point x, then f'(x) 0. 
However, the converse theorem is not true: the equation 
/'(#) = does not imply the existence of an extremum 
at the point x; the example of the function f(x) = oc? 
shows this. The investigation of the derivatives of higher 
orders leads to the following more precise criterion for 
the existence of an extremum. 

Let us assume that f(c) = 0, /"(c) 0, ..., /^-^(c) = 
and / (n) (c) ^ 0. Then, if n is an even number, the function f 
has a proper eoctremum at the point c, namely a maximum, 
if f n ^(c) < 0, and a minimum, if f (n) (c)> 0. But if n is 
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an odd number, then the function does not possess an ex- 
tremum at the point c. (We assume the continuity of the 
n-ih derivative at the point e). 

Indeed, applying the Taylor formula we have 



(24) f(c + h) = 



whence according to the assumptions of our theorem 
we obtain 

(25) 1(c + h}-f()^ J ~^\c+0k). 

Let us assume n to be an even number and let f (li) (c) < 0. 
Because of the continuity of the function / (/l) at the 
point c we know there exists a d > such that the in- 
equality \x c\ < d implies f (n) (x) < 0. Since \0h\ < d for 
\h\<d, so /<">(<? +0/0 < 0. Hence we conclude by (25) 
that if < \h\ < 6, then f(c + h) f(c) < (because h n > 
for even n). This means that the function / possesses 
a maximum at the point c. 

It is proved by analogous arguments, that if n is an 
even number and if / (n >(0) > 0, then f(c + h) f(c) > 
and thus the function has a minimum at the point c. 

Now, let us assume that n is an odd number. Let 
/ (fl) (c) < (in the case / (7l) (<?) > the arguments are analo- 
gous). As before we choose a number 6 > in such a way 
that /< w >(o+ 0h) < for \h\ < d. Then for < h < d we 
have the inequality f(c + h) f(c) < 0, i. e. f(c) > f(c 
and for d < h < 0, we have the inequality f(c 
/( c )>0 showing that f(c)<f(c + h). Thus, there is 
neither a maximum nor a minimum at the point c. 

EXAMPLE. The function f(x) = x n possesses a minimum 
at the point 0, if n is an even number. If n is odd, then 
there is no extremum at this point. 
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Indeed, the first derivative of the function x n not 
vanishing at the point x = is the n-th derivative (cf. (1)) 
and f (n ^( 



Kemark. The previous theorem does not determine 
for all functions (arbitrarily many times differentiate) 

whether an extremum exists at a given point (e.g. for 
i 

the function e x * considered in 8.4 all derivatives of 
which vanish at the point 0). However, it always permits 
us to answer this question for functions having a Taylor 
expansion (formula (21)) in a neighbourhood of a given 
point a. For, it follows from formula (21) that if the 
function / is not constant, then not all derivatives of 
this function vanish at the point a. 

8.7. Geometrical interpretation of the second derivative. 
Points of inflexion 

As we have seen in 7.7, 3, if f'(c) > 0, then the 
function increases in a neighbourhood of the point c. 
Hence if f"(c) > 0, then the function /' increases; thus, 
assuming f(c) > 0, the function / increases faster and 
faster. 

1. If /"(<?) > 0, then in a certain neighbourhood of the 
point e the curve y = f(x) lies above the tangent of this 
curve at the point [c,/(o)] (thus, it is directed with the 
convexity downwards). 

Analogously, if f"(c) < 0, then this curve lies locally 
below thi, tangent (thus, it is directed with the convexity 
upwards). 

In both cases we assume the continuity of the second 
derivative. 

Indeed, let us estimate the difference between the 
differences quotient and the derivative 
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According to the Taylor formula, we have 

7,2 

/ (c + h) - / (c) - hf(e) = \ f'(c + 0h) . 

Hence, assuming f"(c) > 0, for sufficiently small h we 
also have j"(c+0h)>Q, from which it follows that 
f(c + h) f(c) hf'(c) > 0. Interpreting the differences quo- 
tient as the tangent of the angle between the secant 
and the JT-axis we conclude that for h > this tangent 




f(c) 



c+h 



FIG. 22 



is greater than f'(c), i.e. greater than the tangent of 
the angle between the tangent and the X-axis. This 
means that the arc of the curve lies above the tangent. 

The proof of the second part of the theorem is com- 
pletely analogous. 

EXAMPLE. The parabola y = a? 2 lies, in the neighbour- 
hood of any point, above the tangent at this point. The 
second derivative is equal to 2. 

A curve y = f(oc) is said to possess a point of inflexion 
at the point c, if for sufficiently small increments 
h (]A| < d) the arc of the curve lies for positive increments 
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on the other side of the tangent to the curve at the point 
[e, /((?)] from what it does for negative increments. In 
other words: if a number d > exists such that the 
expression 



is positive for < Ji < d and negative for > h > d 
or conversely: negative for < h < d and positive for 
> h > - d. 

EXAMPLE. The sinusoidal curve y = sin# has a point 
of inflexion at the point 0. Indeed, sinfe sinO frcosO 
sin/i -h. This difference is negative for 7&>0 and is 
positive for h < 0. 

Similarly, the cubic parabola y a? possesses a point 
of inflexion at the point 0. 

It follows from theorem 1 that if f"(c) ^ 0, then the 
curve lies (locally) on one side of the tangent. Hence 
the point c is not a point of inflexion. In other words: 

2. // a point c is a point of inflexion of a curve y f(x), 
then /"((?) - 0. 

This theorem cannot be reversed: the second deriva- 
tive may vanish at a point c although the point c is riot 
a point of inflexion (just as the first derivative may 
vanish although there is no extremum at the given point); 
e.g. the curve y = a? has a minimum at the point 
and so this point is not a point of inflexion of this func- 
tion although the second derivative I2x 2 vanishes for x = 0. 

To get a more precise theorem, further derivatives 
have to be considered. This leads to the following theorem: 

3. If f"(c) = 0, /'"(c) = 0, ... , p-V(c) - but fW(c) ^ 
then in the case of an odd n the curve y = f(x) possesses 
a point of inflexion at the point c; in the case of an even 
n, c is not a point of inflexion. (We assume the continuity 
of the ^-th derivative at the point c). 

Indeed, applying the Taylor formula (24) we obtain, 
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Let us assume n to be an odd number and let / (n >(c) > 
(the arguments in the case / (n >(<?) < are analogous). 
Then for sufficiently small increments h we have 
/<)(c+ 0h) > 0. Hence we have ip(h) > for fe > and 
y(h) < for h < 0. Thus, the point c is a point of in- 
flexion of the curve y = f(x). 

On the other hand, if n is an even number, then h n > 
independently of the sign of 7&, whence y(h) has the same 
sign as / (n) (o). Hence the curve lies on one side of the 
tangent to the curve at the point [c, /(<?)]. Thus, the 
point c is not a point of inflexion. 

Be mark. As in the case of the extrema, the question 
whether c is a point of inflexion may always be answered 
(according to Theorem 3) for functions expansible in 
Taylor series in a neighbourhood of the point c. At the 
same time the points of inflexion of the curve y = f(x) 
are extrema of the curve y = f'(x). 

Exercises on 8 

1. Prove the (Halphen) formula: 



1O& T* 

2. Find the w-th derivative of the functions: , 

x ' 

& cos x. 

3 r . Evaluate: 

,. e? e~ x ~ 2x ,. # sin# ,. /I , 9 \ 
hm - ; -- . lim - = . lim -r cot 2 o?l . 
ro ^ sin a? x-o & o \^ / 

4. Expand the functions sinh# and cosh# in power 
series. 

j. 

5. Sketch the graphs of the functions #*, & , log sin a?, 
showing their extrema, points of inflexion, asymptotes, 
points of one-side discontinuity or points of both-sides 
discontinuity (if any exist). 
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6. Prove that if an n times differentiable function 
vanishes at n+1 different points of a given interval, 
then there exists in this interval a point at which the 
n-th derivative vanishes. 

1 -- 

7. Let i(x) = e x * for x ^ and /(O) = 0. Prove that 

x 

/'(O) = 0. Deduce as a corollary that the function g de- 
fined by the conditions 

_j_ 
g(x) = e~* for x = and #(0) = 

possesses at the point derivatives of all orders equal 
to (cl 8.5, Eemark (a)). 

tyin 

8. Prove that e n < (2n + 1) . Deduce that 

IV 

lim - \ ' nl = - . 



CHAPTER IV 

INTEGRAL CALCULUS 

9. INDEFINITE INTEGRALS 

9.1. Definition 

A function F is called a primitive junction of a func- 
tion / defined in an open interval (finite or infinite) , 
if F'(x) = f(x) for every x. 

For example the function sin a? is a primitive function 
of the function cos#. Any function of the form sin a? + (7, 
where C is a constant, is also a primitive function of the 
function cos a?. 

If a function / is defined in a closed interval a < x < fc, 
then the function F is called its primitive function, if 
F'(x) = /(a?) for a < x< 6, F+(a) - f(a) and JFL(6) = f(b). 

1. // too functions F and G are primitive functions 
of a function f in an interval ab (open or closed), then 
these two functions differ by a constant. 

Indeed, if F'(x) = (?'(#), then, according to Theorem 4 
of 7.5, there exists a constant C such that G(x) ^F(x) + C 
for every x. 

Conversely, a function obtained by adding a constant 
to a primitive function of a function / is also a primitive 
function of the function /. Thus the expression F(x) + C 
is the general form of a primitive function of the func- 
tion /. We indicate this expression by the symbol / f(x)dx 
("the integral f(x)dx") and we call it the indefinite integral 
of the function f. So we have 

(1) ff(x)dx - F(x) + 0, where F'(x)= f(x) , 
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(2) 
, 



The evaluation of the indefinite integral of a function /, 
i.e. the calculation of the primitive function of a func- 
tion / is called the integration of the function f. So in- 
tegration is an inverse operation to differentiation. 

It follows from the definition of the indefinite integral, 
that any formula for the derivative of a function automa- 
tically gives a formula for the integral of another function 
(namely, the derived function). For example from the 

formula -= = cos#, we obtain J cosxdx = sin# + C. 

ClX 

In general, however, the problem of the calculation of 
the integral of a continuous function, which we do not 
know to be a derivative of a certain function, is more 
difficult than the problem of differentiation. As we have 
seen in 7, the differentiation of functions which are 
compositions of elementary functions does not lead out 
of their domain; yet an analogous theorem for indefinite 
integrals would not be true. It is known only that every 
continuous function possesses an indefinite integral 
(cf. 9.2). However, this theorem gives us no practical 
procedure of evaluating the indefinite integral of a given 
continuous function. 

EXAMPLES. Applying well-known formulae from the 
differential calculus we obtain immediately the following 
formulae: 



(4) 

(5) J adx = ax + C , 

l + C, 



(6) f 

(7) / cos x da; = mix+C , 

(8) / mixdx = cos#+(7, 
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f dx 

(9) - = tana? -t- 6 , 

(10) f*? = 

IT 

7 X/ 

(11) / e*efa 

do/' 

(12) I - = arcshiff+C , 

I I/ 1 - nr& 

C dx 

(13) - = arctano?+C, 

y 1 + 07" 



(14) aPdx = x a+l + C , if a ^ 1 and o? > . 

Eemark. If the domain of x for which the equation 
F'(x) = f(x) is satisfied is not an interval (finite or in- 
finite), then it cannot be stated that the expression 
F(x) + C gives all primitive functions of the function / 
in this domain of arguments. 

For example, log|o?| + C gives all primitive functions of 

the function - in each of the two domains x < and x > 0. 
x 

separately, but not in the whole domain of x real and 
different from 0. Namely, the function G(x) defined as 
log | o? | for x < and as log|o?|+l for x ^ is a primitive 

function of the function - for all x ^ although it is 
not given by the formula log|o?| + 6 Y . 

Let us complete now Theorem 1 as follows: 

2. Let a point X Q be given inside an interval ab and 

let an arbitrary real number y Q be given. If a function f 

possesses a primitive function in the interval aft, then it 

possesses one and only one primitive function F such that 

Let P(x) be an arbitrary primitive function of the 
function f(x) in an interval ab. Let us write F(x) = P(x) 
-P(o? ) + ^o- Then we have F'(x) = P'(x) = f(x) and 
F(x Q ) = 2/0- Hence the function F satisfies the conditions 
of the theorem. 
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Moreover, it is the only function satisfying these con- 
ditions, since any other primitive function of the func- 
tion / is of form F(x) + C, where 0^0, and this implies 



Geometrically, this theorem means that given any point 
on the plane with the abscissa belonging to the interval ab, 
there exists an integral curve (i.e. the graph of a primitive 
function) passing through this point. The integral curves 
being parallel one to another, only one integral curve of 
a given function / may pass through a given point on 
the plane. 

9.2. The integral of the limit. Integrability of continuous 
functions 

We have proved in 7.9 that given a sequence of 
functions F n (x), a < x < b, such that the derivatives are 
continuous and uniformly convergent in the interval ab 
to a function g(x) and that the sequence F n (c) is con- 
vergent for a certain point c belonging to the interval ab, 
the sequence F n (x) is convergent for every x belonging 
to this interval; moreover, writing F(x) = ]imF n (x), we 

71 = 00 

have F'(x) = g(x). 

Hence, the following lemma follows: 

1. If the functions f n (%) are continuous and uniformly 
convergent in an interval ab to a function f(x) and if they 
possess primitive functions, then the function f(x) pos- 
sesses also a primitive function. 

The primitive functions F n (x) may be chosen in such 
a way (according to 9.1, 2) that the equation F n (c) = 
holds for a certain point c of the interval ab, for each 
value of n. Then 



f f(x)dx=\imF n (x) + C, 



i.e. the integral of the limit equals to the limit of the 
integrals. 
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Indeed, to obtain our lemma it is sufficient to sub- 
stitute in the above formulation f n in place of F' n and / 
in place of g. 

2. THEOKEM. Every function continuous in an interval 
ab possesses a primitive function in this interval. 

By the theorem proved in 6.4, every function con- 
tinuous in the interval ab is a limit of a uniformly con- 
vergent sequence of polygonal functions. Hence, according 
to the lemma it remains only to prove that any polygonal 
function / possesses a primitive function. 

According to the definition of a polygonal function 
there exists a system of n+1 points a Q < a l < ... < a n ^ 
where a a, a n = fc, and two systems of numbers 
6 'i> 6 'a? ? n and d 1? d 2 > ? dn such that 
/(#) = c k x+ die for a k -i < x < a k (k = 1 , 2 , ... , ??/) . 

Let us write 

-**(#) = i CA- a? 2 + d k x + e k for a fc -i < a? < a fc , 
where e t and 



for ^ 1. 

Then F k (a k ) = I 7 fc+i(a fc ), whence the collection of the 
functions I\,]<\, ...,F n defines one function equal to each 
of the functions of this collection in the suitable interval, 
respectively. 

Differentiating the function F k we obtain immediately 
J?'(x) = f(x), i.e. the function F is primitive with respect 
to the function /. 

9.3. General formulae for integration 

Let us assume the functions / and g to be continuous. 
Then the following formulae hold: 



since 



f(x)doc+ j g(x)dx\ 
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2. / af(x)dx = a j f(x) dx , 
since ^ (a f f(x)dx\ - a^ J /(#)*& - 

EXAMPLE. The integral of a polynomial: 



n + 

3. T/ie formula for the integration by parts: 



- f'(x)g(x)dx 

(if the functions /' and g' are continuous). 

We write this formula more briefly, taking y == f(x) 
and z = g(x) as follows: 



y dx = 7/s -- c?.r . 
J ^da? l J da? 



To prove this formula, let us differentiate its right 
side. We obtain: yz' + y'z zy' = yz'. This is the integrated 
function of the left side of the formula. Thus the formula 
is proved. 

A special case of formula 3 is the following formula 
obtained from the formula 3 by substitution z = x: 

3'. I ydx = yx I x~^dx. 

EXAMPLE. J logxdx = #log# J x-dx~x\ogxx+ C. 



4. The formula for integration by substitution (i.e. the 
formula for the change of the variable): 

x^ g(y)dy, 



where on the right side it has to be substituted y = f(x) 
after evaluation of the integral. 
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We rewrite this formula more briefly, writing y = f(x) 
and z = g(y), as follows: 



Let us write G(y) = j g(y)dy. To prove the formula 4 
it has to be shown that the derivative of the function 
#[/(#)] i g equal to the integrated function on the left 
side of this formula. Now, 



ldG(y)\ df(x) <*/(*) 

- -- i - ) - = g\](x)\ = . y. fj. JJ. 
dx \ Ay Jy-Hx) dx t/L/v dx ^ 

As is seen, from the point of view of the calculation 
we may reduce by the differential. The formula 3 may 
be written also in the following form: 

I ydz = yz j zdy . 

EXAMPLES, (a) / g(ax)dx = ~j g(y)dy, where y = ax. 

d 

Namely, substituting f(x) = ax in the formula 4, 
we have 

- I g(ax)aAx = - g(y)dy . 

tv ' II J 

(P) Similarly we j^rove that 

I f(x + a)dx = j f(y)dy , where y = x + a . 

* /y /7 /y 

(y) ( x ) To evaluate the integral J * we substitute 

JL ~j~ ^ 



*. We obtain: 



C xdx ___ /* 1 1 d(x*) 
J l+o? 2 = J l+x*'2'~dx~ 



dx 



( x ) To simplify the calculation, we omit the constant C in the 
example (y) and in the further examples. 
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Since as we said by the integration the differential 
df(x) may be substituted in place of f(x)dx, i.e. in the 
given case, d(x*) in place of 2xdx, the above calculation 
may be performed in a little shorter way: 

xdx f 1 dx 2 



(S) We have for w > 1 



/* 

J 



f, , /' sin# /*cZcos# . , , 

ta>nxdx = - ax - = log cos #. 
J J cos# J cos# tol l 



The formulae (y) and (e) are easily obtained from the 
following general formula: 



y dx J y 

Substituting y = 1 + .T 2 in formula (S) we deduce this 
formula easily from the following general formula: 



J 



As is seen, the method of integration in the above 
examples consists in finding a function y = f(x) such 
that the given integral will be transformed in an integral 
with respect to y (which is easier to calculate). This 
makes it possible to replace the calculation of the integral 
on the left side of the formula 4 by the calculation of 
the integral on the right side of this formula. Sometimes, 
the reverse procedure, i.e. the replacing of the right 
side by the left side is more suitable; to calculate the 
integral / g(y)dy we look for a strictly monotone func- 

tion y = f(x) such that the integral / g[/(#)] ^ dx 

a/x 

may be easily calculated. Denoting by x = Ji(y) the func- 
tion inverse to y = f(x) and by F(x) and 0(y) the integrals 
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on the left side and on the right side of the formula 4, 
respectively, we have then 



In other words, 



where in the integral on the right side has to be sub- 
stituted x = h(y). 

EXAMPLE. Let us substitute in the following integral 
x = sinJ, - 2 < t < ^: 



J yi 



dt = 



but cos 2 J = |(l + cos2<), whence / co&tdt = %t 

Since sin2J = 2sincos = 2sinJ |/1 sin 2 ^, we obtain 

hence: 




E em ark. We verify the correctness of the integration 
by differentiating the function obtained as the result of 
the integration. After the differentiation we should obtain 
the integrated function. 

5. Recurrence methods for calculation of integrals. The 
recurrence method for calculation of the integral / f n (x)dx 
consists in calculation of the integral for n = 1 (or for 
n = 0) and in reducing the n-th integral to the n 1-th 
one (or an even earlier one). 

EXAMPLES, (a) Evaluate the integral l n = / e~ x x n dx. 
Now, I = / e~ x dx e~ x . Moreover, integrating by parts, 
we have (for w>0): 

JC dotf* 
ard(e- x ) = tf n e~ x + J e~ x -=--dx 
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In particular, 1^ = xe- x +I Q ^ I 2 = x*e~ x + 2I 1 , ... Multi- 

i r i, i T ^ w - r T, w - 

plying JT by n!, ^ by , ... , I n _! by _ ? succes- 



sively, and adding, we obtain 

/ 
- 



we have for n > 1 



/fj/p 
- . Now, Ij = arctan#. Moreover, 
(1 + x ) 
e for n > 1 

r __ fl + ^ 2 x * j __ r f ^ 2 ^ 

"~J d+^r J oT^' 



Since 

_ 9 A _i 

"" ( 



we obtain integrating by parts 

r a?dx 1 r , 1 

- ~ - xd -- 

j (i+x 2 r 2n-2j (i+ay- 1 
- 1 






Consequently, 

1 x 



2n-3 



This is the required recurrence formula. 
(y) Let y = /(a?), 2 = gf(a?). We calculate the integral 
applying n times the integration by parts: 



J 2i/< n + 1 ) do? = 5?j/ (n) J ^'i/ (n) dx , 

J 2>( w ) ^a? = z'y( n -v J z'Y n ~ l) dx , 



J z^y'dx = # (n > y J z( n +v y dx . 
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Hence 



+ ... + (-If * (n) y + (-l) n+ 1 f 

This formula may be applied e.g. to the previously cal- 
culated integral / e~ x x^dx after taking into account that 



' dx k 

9.4. Integration of rational functions 

Let a rational function 



be given, where P(x) and Q(x) are two polynomials. 
The integral / j(x)dx has to be evaluated. 

We may assume that the degree of the numerator is 
less than the degree of the denominator. For, if this were 
not so, we could divide the numerator by the denominator 
and then we have to integrate the sum of a polynomial 
(eventually reduced to a constant) and of a fraction, 
the numerator and the denominator of which are poly- 
nomials, and the degree of the numerator is less than 
the degree of the denominator. The first of these two 
terms is easy to integrate (as a polynomial); thus our 
task is to integrate the second component, i.e. a quo- 

P(x) 
tient of the form nf , where the polynomial P(x) is 



of a degree less than the degree of the polynomial Q(x). 

The following theorem on rational functions is proved 
in books on algebra: 

Let us call an expression of the form 

A Cx + D 

or ^ 



(x-pf 

where A and PJ or C, D, q and r are real numbers, a partial 
fraction. 
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Then a rational function n/ ~{ is a sum of partial 



fractions the denominators of which are the factors of the 
polynomial Q(x). 

To decompose a rational function into partial frac- 
tions, first the polynomial Q(x) has to be factorized 
into prime factors. Then the coefficients appearing in 
numerators of the partial fractions! have to be found. 
The factorization of the polynomial Q(x) in factors is 
obtained applying the theorem known from algebra stating 
that if p is a (real or complex) root of the equation 
Q(x) = 0, then a? p is a factor of the polynomial Q(x)\ 
moreover, if p is a root of the multiplicity n, then (x p) k 
is a factor of this polynomial for each Jc < n. Finally, 
if u + iv is a complex root of the equation Q (x) = with 
real coefficients, then u iv is a root of this equation, 
too (of the same multiplicity), and so the polynomial Q(x) 
has the product (x u iv)(xu + iv) = (a? u) 2 -\-v 2 as 
a factor. 

The coefficients appearing in the numerators of partial 
fractions are usually found by the so called method of 
the undetermined coefficients, which we shall learn by 
examples. 

The denominator of the rational function -. :r 

(x 2) 2 (x 3) 

possesses the factors (x 2) 2 , (x 2) and (#3). Thus, 
our rational function is of the form 

x-l A B C I 



(x-2)*(x-3) (x 

To calculate the coefficients A, B and 0, we reduce the 
fractions on the right side of the above equation to 
a common denominator. We obtain 

07-1 



(x-2)*(x-3) 



(x-2)*(x-3) 
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The numerators on the left side and on the right 
side of the above identity are equal one to another for 
any value of x. Hence it follows that 

B + C = 0, A-5B-4:C = 1, -3A + 65 + 4(7 = -1. 
These equations give the values A, B and 0: 
A=-l, B = -2, = 2. 

Consequently, 

0-1 -1 22 



We note that the coefficients JL, jB, and C might be 
found in a slightly simpler way as follows. After reducing 
to the common denominator we obtain the following 
identity: 



Substituting in this identity x = 2, we obtain A = 1; 
the substitution x = 3 gives C = 2. Hence, substituting 
x = 1, we conclude J5 = 2. 

Another example of the decomposition of a rational 
function in partial fractions is given by: 

x-1 Ax + B , Cx + D , .E 

+ 



Eeducing to the common denominator we obtain the 
identity 



whence we easily find: 



The theorem on the decomposition of a rational func- 
tion into partial fractions reduces the problem of inte- 
gration of rational functions fcto the integration of partial 
fractions. Now, we shall see that the partial fractions may 
be integrated by the methods which we have learnt already. 
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Indeed, substituting y ==x p we obtain 

. 7 . 

for fc==1 > 



A 1 

or = - 7 --TT-T for k > 1 , respectively. 
1-fc y k ~ l 

The evaluation of the integral 



is reduced to the evaluation of two integrals: 

r dx r (x-g)dx 

J Ka-tf + i*? ana J [(-8) 



Substituting y xq, the first of these integrals ii 
reduced to the integral / 8 a . fc , which is reduced by th< 

\C' I / 

/fj/y 
2 , 1 ^ which w< 

already know (cf. 9.3, 5 (p)). 

The second integral we find by the formula 9.3' ( 
and (YJ) substituting y = (# 2) 2 + ^ 2 ; namely, 



(xq)dx 



- 



or = 



according to whether fc = 1 or fc ^ 1. 

Hence, the integration of rational functions can alwayi 
be carried out (of course, if the roots of the equatioi 
Q(x) =0 are known). 

/ /y / y 
EXAMPLES, (a) I = J . Since 

X ~\~ X ~t~ JL 
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1 2 

so substituting first y = x + - and then z = -i=.y, we obtain 

2 1/3 

d!t/ r %dy 2 r dz 2 
y ' s ^ _ i arctanz 



C y 
= ? = 

J / 2 + 



1/3 



-/^: (a? + -| 
1/3 \ 2] 



= ff A 
J [(a?- 



-dx 

3 C . D 



dx 



Eeducing the right side of this equation to the common 
denominator, we easily find: A = 3, B == 4, C = 2, D = 1. 
Integrating, we obtain 



K em ark. Analysing the method of integration of 
rational functions, we state that the integral of a rational 
function is of the form 

W (x) + A log U (x) + B arc tan.7 (x) , 

where W(x), U(x) and V (x) are rational functions and A 
and -B are constant coefficients. 

9.5. Integration of irrational functions of the second degree 

We shall consider an integral of the form 

I = J i/a# 2 + bx + cdx . 

First of all, let us consider the case when a = 0. 
Then we may assume that 6^0, since otherwise the 
function under the sign of the integral would be reduced 
to a constant. Hence, we have to evaluate the integral 
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_ 

We substitute t = bx + c, i.e. # = - , whence 

-=- = T . Then the integral is transformed into the f onew- 
ay o 

ing integral: 



Now, let us assume that a i=- 0. We consider two cases: 
(1) 6 2 4ac > 0. As is known, this assumption implies 
that the equation ax* + bx + c = possesses real roots 
and the trinomial of second degree is of the form ax 2 + bx + o 
= a(x p)(x g), where p and # are the roots of the 
above equation. Thus, we have 



=\ \/ax* + bx + cdx = I (x 






x o ao t 

Let us substitute a = *, i.e. x = - 

x p ' a i 

We obtain 



T f *aqap dx , , 

f I f * . . /+ 

J a t 2 dt fl ' 



This integral being an integral of a rational function 

/7 / 7* 

(since -=- is a rational function, as is easily seen), it 
ctt 

may be calculated by the methods given in 9.4. 

(2) 6 2 4ac? < 0. In this case it may be assumed that 
a > 0, since otherwise the trinomial constituting the func- 
tion under the sign of the root, which is of the form 
a [(x a) 2 + /3 s ], would be always negative. We apply the 
following Euler substitution: 



i.e. bx + c = 

that is 

F-c 

/y ________________ 

b-2t} / a' 
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Since j/W 2 + bx + c as well as -=r are rational functions 

cut 

)f the variable J, so our integral is reduced to an integral 
>f a rational function. 

The above Euler substitution may be applied also in 
Jie case (1), if only a > 0. 

If c> 0, the second Euler substitution may be applied: 

]/a# 2 + bx + o = xt + j/c , i.e. ax + b = xt 2 + 2t j/0 , 

ijhat is 

2t j/c - b 
x = t . 

Similar to the previous case, we see that this substi- 
tution reduces the integral / to an integral of a rational 
function with respect to the variable t. 

Consequently, we conclude that the integral I may 
t>e evaluated for all values of the constants a, 6, and c. 
[t follows also from the above considerations easily that 
i R(u, v) is a rational function of the variable u and v, 
jhen the integral 

J E (yax 2 + bx + c , x} dx 

is reduced to the integration of a rational function (thus, 
bhe integration is performable). 

(Iff* 

EXAMPLES, (a) Let I = ,. for x z > c. We shall 



ipply the first Euler substitution in a slightly modified 
form. Namely, let us substitute }/x 2 + c = t x, whence 



t z -c , dx 

- and = 



c 
Hence t x= and 



2t t 2 +c, cat 



_ 
= log|t| + C = log \x+ ]/a? + c\ + C . 
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(P) I = i/x 2 + cdx for x 2 > c. This integral may be 
evaluated by means of the Euler substitution. However, 
it may be calculated more simply by reduction (by inte- 
gration by parts) to the previous integral. Namely, 




Let us note that the formulae for the derivatives of 
the functions inverse to th& hyperbolic .functions ( 7, (22) 
and (23)) make it possible to write directly the formulae 
for the integrals considered in the example (a) for c = 1. 
Namely, 

dx 



dx 



+0, 



= arcosho?+C =log#+ }x 2 1 + (7 for x>l 



Be mark. As we have seen, the integration of ir- 
rational functions of second degree is always performable. 
However, replacing the quadratic ax* + bx + c under the 
sign of the root by a polynomial of the third or higher 
degree, the problem of integrability becomes in general 
(i.e. without special assumptions on the coefficients) 
impossible to solve in the domain of elementary functions. 

In particular, the integral 

dx 



cannot be expressed by means of elementary functions. 
Thus, it leads outside the domain of elementary functions 
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/7/v 

(similarly as the integral J leads outside the domain 

CO 

of rational functions). It is the so-called elliptic integral. 
Similarly, the integrals 

dx r doc 



r x r oc 

J |/cosi2a?' J l/l fc 2 sin 2 # 



cannot be expressed by means of elementary functions 
(and lead also to elliptic integrals). 

9.6. Integration of trigonometric functions 

Let R(u, v) denote a rational function of two variables 
u and v. The method of integration of the function 
jR(sin#, cos#) is based on the substitution J = 

We conclude from the identity 

COS 2* 

that cos 2 ^aj = and, since cosx = 2cos*|# 1, 

2 l-< 2 

C08a , = 



___ __. 

At the same time, 

t 2 
sin 2 Jo? - 1 - cos 2 Jo? = , 

whence 

2t 
sina? 2 sin ^ cos \x 2 . 

Finally, the equation # = 2 arc tan t implies 

dte _ 2 
"^ "~ 1+T 2 ' 

The above three formulae give 

// 
(in, >*)* -J 



and the last integral, being an integral of a rational 
function of variable J, may be calculated by methods 
with which we have already become acquainted. 
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EXAMPLES, (a) Let I = J . Applying the substi- 

COS t>C 



tution t = tan Jo? we obtain 

i- fl. *-*- [ 2dt 
J i-* 2 i+p J i-< 2 



,1-t 

But ~^. = T T T = tan(# + JTT). Consequently, 
i * 1 tan % x 



/ 



cos# 
Hence 



f <fo 
J sin^ = 

since sina? = cos(o? |TT) and so 

f dte f d(x i:r) . ., - , 

~ = S ^rAr^iog tanio? . 
J sma? J cos(o? ^TT) &l * ' 



The last integral; may also be deduced easily from 
the integrals (cf. 9.3, (e)): 

J tan#d# = log[coso?| , J cotiP^ = log|sin#| , 



since 



f da? _ f <to _ - f si ( ? 

J sino? "~ J 2sm|a7cos|a? ~ 2 J sin^cos 

= I tanjo?d(ja?)+ I 



/ // / 7* 

If we know the integral f , we find immediately 

& J ' J 



the integral / -- , substituting cos# = B 

COS 00 

(P) The irrational functions of second degree may be 
reduced easily to trigonometric integrals of the form 



9. INDEFINITE INTEGRALS 221 

12(sin#, cos a?). Namely, the functions 



may be reduced to the functions of this type by sub- 
stitutions x = sin/, x = tan/, x sec/; in any of these 

three cases the derivative -=- is also a rational function 
of the functions sin/ and cos/. Namely, 

A =-T7 . dsin/ 

yi sin 2 / = cos/, ~ = cos/, 

/i 57T-q ^ ! dtan/ 1 

i/ tan 2 / +1 = sec/ = , ^ = , 

cos/ dt cos 2 / 



-1 = tan/ = 



sin/ d!sec/ sin/ 



cos/' dt cos 2 / ' 
e.g. 

i/ a +lflte= r^, where # = tan/. 
J r J cos 3 /' 

Sometimes it is more convenient to substitute x = cos/ 
instead of x sin/ or a? == cot/ instead of # = tan/; e.g. let 
us substitute x = cot/ in the integral 

r dx r . dcoit , 4 r 5/ i u m 

. = sm/ a/ = log tan*/ 

J VV+I J dt J sin/ 



Since - = tan/ = - - |JT , so 
Hence we find the integral 



= log 



calculated previously in another way. 

Now, we shall give some other types of integrals of 
trigonometric functions, being of importance in appli- 
cations. 

The integral I n = / 8in n xdx. 



f n-l f 

L * I sin x Cv c*ob x ~~~ sin $/ oos P i~ i ci/v^ a */ 
j J dx 
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We shall give the recurrence formula. 

;W OAJ-L */ ., 

cosa? 5- do? 

l-l) f 

i 1) I n -2 (n ] 
since cos 2 a? = 1 sin 2 # . 

Hence the required formula: 

I n si^^^cosaJH -I n -z (for n>2). 

Similarly, we find 

/I %l f 

~~ n ^i J "" 

The integrals 

/r r 

smma?sinno?aa? , J sinmo?cosw#a# , J cos mx cos nx dx 

can be evaluated applying the formulae 

QITI win w QiTi fin w 1 ir*f~isi / wn 10 ^ ^y* - r*no I / Yt I 'W \ o^T 

Oil A livtJU olll r c/t*/ ^" I C/vlo y I tv tv f JL> \j\J\5 \ II v j^ IV i \J(J J 

siumxeosnx = ^[sin(m + n)^ + sin(m n)x] , 
cosw#cos^# = |[cos(m + n)o? + cos(m 'S 

known from the trigonometry. 
We find easily: 

sin mx sin nx dx = 

for 



m n m + n 

1 / sin2mo?\ . 

[ x -- - \ f or m==n 

' 



-- - 
2 2m 



w v ,,. , , y/w w v , y ^^ ^ ^ 

2[ m + n m n J ' 

1 cos2mo? v 



2 2m 



for m = n , 



I 
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cosmxcosnxdx = 



The integral I 

J 



+ " v ^^ for m? 
mn J 

+ x\ for m = n . 

dx 



To calculate this integral, we write the denominator 
of the function under the sign of the integral in the form 
6'sin(#+<9). The values of c and we find from the 
identity: 



i.e. 



that is 



_ 

c = ]/ a 2 + 6 2 , = arctan - . 

a 



We obtain 

f cte _1 f d(x+0) __ 1 

J asin# + 6cos# ~~ c J sin(a?+ 0) c 

Eemark. In 9.2, 5 we gave the recurrence formula 

for the integral / r . This integral maybe calculated 

(l + x ) 

also applying the formula for the integral / cos m xdx. 
Namely, substituting x = tan/, we obtain 



f *% = rcOB^^^'= f 

J (l+x 2 ) n J dt J 



(1+aO' 

Exercises on 9 

Find the indefinite integrals of the following functions : 

5. arctan#, 6. o^(loga?) w , 
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1 



7. -rV > 8 ' 

sm 2 # 

# 2 -# + 4 1A 



9. 
11. 



13. , substituting i/# 2 + c = x + 1 

(cf. 9.5, Example (a)), 

14. /" (m an integer), 




15. / (m an integer), 

16. 



(a? 2 + c 2 ) 71 |P^ 2 + 2^ + r 

E em ark. Prove that if E is a rational function 
of two variables, then R (x , |/ao? 2 + bx + c) = 



H ===== , where J7 and W are rational functions. 



Hence deduce (by 14-16) a general method for integra- 
tion of irrational functions of second degree. 

17 Oot^ 'T* "1ft SOO^ 'T 1 "1 Q SlTl^^ ^OOfi^ / 7* 

o^ oo o-i arc sin a? 
20. eostf- cos2a? cos3#, 21. . 



10. DEFINITE INTEGRALS 

10.1. Definition and examples 

Let a function y = /(#) continuous in a closed interval 
a < x < b be given. By the definite integral f(x)dx from 
a to b we understand 

b 

(1) 
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where F is an arbitrary primitive function of the func- 
tion / in the interval aft, i.e. F'(x) == f(x) for a < x < ft, 
F'+(a)=f(a) and JFL(6) =/(&). 

The definite integral does not depend on the choice 
of the function JP; this means that if G is also a primitive 
function of the function /, then 

G(b)-G(a)=F(b)-F(a). 

This follows immediately from the fact that the dif- 
ference between the functions G and F is constant in 
the interval a ^oo ^b (cf . 7.5, 4, Eemark). 

The formula (1) will be assumed also in the case 
when ft < a. Hence we have 

a b 

(2) f f(x)dx = - f f(x)dx 

b a 

and 
(3) 



From Theorem 2, of 9, 2 it follows immediately 
that every function continuous in an interval a ^. x ^ b 

b 

possesses the integral / f(x)dx, that is, as we say, it is 

a 

integrable in this interval. 

To indicate the difference F(b)F(a), we use also 
the symbol 



Be mark. It follows from the definition that the 
definite integral depends on the function / and on the 
limits of integration. However, it is not a function of 
the variable x (x appears here only as a variable of 
integration). The value of the integral will not be changed, 
if we replace the variable x by another variable, e.g. t: 

b b 

f f(x)dx = f f(t)dt. 



15 
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b 

EXAMPLES, (a) / cdx = c(b a). Indeed, we have 

a 

b 

J cdx = cx + 0, whence / cdx = [cxf a = c(b a). 

a 
I 

(P) / x*dx = J, because / x 2 dx = # 3 + (7, whence 
o 



o 

71/2 

(y) / sinxdx = [ cos#]* /2 = cos(7r/2) + cosO = 1 . 



(S) The following definite integrals (Fourier's, 
cf. 11.7) are easily found on the basis of the formulae 
for the indefinite integrals ( 9.6): if m and n indicate 
two different positive integers, then 

7T Jt 

J wimx&mnxdx = = J cos mx cos nx dx, 

n n 

for arbitrary positive integers m and n: 

7T 

J smmxvosnxdx ~ ; 

7t 

for arbitrary positive integer m: 

n TT 

J sin 2 mo?^ = TU = J cos 2 ma?da? . 

re 7t 

(e) For an arbitrary positive integer w the formulae 

7T/2 



71 

*2 ' 



7t/2 

/- 



(4) I m& n xdx = 



hold. 

These formulae follow easily from the recurrence 
formula ( 9.6): 

/&in n xdx = sin'^aJCOSOJH I &m n ~ 2 xdx (n > 2) 
n n J v 
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and from the formulae: 
1 



f 1 
-- 

L n 



= , 
Jo 



71/2 7T/2 

J sm l ocdx = 1 , J sin 
o o 

Let us note that if we replace sine by cosine, then 
the formulae (4) remain true. 

10.2. Calculation formulae 

The first three general formulae for the indefinite 
integrals ( 9.3) lead immediately to the following three 
calculation formulae for the definite integrals (we assume 
that the functions under the signs of the integral are 
continuous in the closed interval of integration): 

6 b b 

1- /[/(aO0(ff)]*= $ 1(x)dxj g(x)dx, 

a a a 

b b 

2. J c- f(x)dx = c J f(x)dx , 

a a 

b b 

3. / 1(x)g'(x)dx = U(x)g(x)? 



The formula for integration by substitution leads to 
the following formula: 

b /(&) 

4. Jflf[/(n/ / ()*= f g(y)dy. 

a /(a) 

Namely, let G(y) be a primitive function of the func- 
tion g(y). Then (by formula 4 of 9.3), #[/(#)] is the 
primitive function of the function </[/(#)]/'(#) Thus, ac- 
cording to the definition of the definite integral, 



= g(y)dy . 

/(o) 
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5. The theorem on the division of the interval 
of integration: 

ebb 

f i(x)dx + f f(x)dx = f f(x)dx . 



Namely, denoting by JF'a primitive function of the 
function /, we have 



6. // /(#) >0 and a < ft, then J 



Indeed, denoting by F a primitive function of the 
function /, we have F'(x) = f(x) > 0; hence it follows 
that the function F is increasing (in the wider sense). 

b 

So F(a)^F(b), i.e. / f(x)dx = F(b)-F(a) > 0. 



Formula 6 implies the following slightly more general 
formula: 

b b 

7. // /(#) ^g(x) and a < ft, then j j(x)dx< / g(x)dx. 

a a 

By assumption, g(x) f(x)^0. Thus, by 6, we have 

b 

1(x)~\dx > 0, whence by 1, 



I g(x)dx j 



As is seen from formula 7, the relation < remains 
unchanged by the integration (when a < b). We shall 
deduce from 7 the following two formulae: 



b 



8. |//(a?)te|< j\i(x)\dx, if a<b. 



a 
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Namely, it follows (according to 7) by integration of 
the double inequality 1/(#)| </(#) < (/(#)! 

b b b 

f -\f(x)\dx^f f(x)dx < / \i(x)\dx , 

a a a 

i.e. 

b b b 

- f \f(x)\dx < / f(x)dx < / \1(x)\Ax . 

a a a 

Hence we get the required formula (since the inequality 
u^v^u implies the inequality \v\ < u (cf. 1, (17)). 
9. The mean-value formula. 

a+h 



where is a suitably chosen number satisfying the con- 
dition < 9 < 1. 

Let F denote a primitive function of the function /, 
i.e. F'(x) =f(x). Then we have 



a+h 



according to the mean-value theorem of the differential 
calculus ( 7.5, (p)). 

10. Let a function / be continuous in the interval 
a < x < b. Let us write 

X 

(1) g (x) = //(*) dt (i). 

a 

Then the following basic formula holds: 

X 

(2) g'(x) =/(), i.e. ^ / f(t)dt = /(), 



It may be also written g(x) = f f(x)dx. 
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x 

i.e. the integral / f(t)dt, considered as a function of the 

a 

upper limit of integration, is a primitive function of 
the function under the sign of the integral. 

To prove this, let F denote an arbitrary primitive 
function of the function /, i.e. let F'(x) = /(#). According 
to the formula (1) of 10.1, we have g(x) = F(x)F(a). 
Differentiating, we obtain g'(x) = F'(x) = f(x). 

Remarks, (a) At the ends of the interval of inte- 
gration we have 

g'+(a)=f(a) and gL(b)=f(b). 

((3) Let us note that the function g is continuous as 
a differentiate function. 

11. If a sequence of continuous functions j n (x), a < x < 6, 
is uniformly convergent to a function f(x) in the interval aft, 
then the integral of the limit is equal to the limit of the 
integrals: 

b b 

(3) / i(x)dx = lim J f n (x)dx , 

a *=a 

b b 

i.e. J [lim/ n (#)]$# = lim J f n (x)dx . 

a n=oo n=oo a 

Since the limit of a uniformly convergent sequence 
of continuous functions is a continuous function ( 6.1, 
Theorem 1), the function / is integrable. Applying the 
formula 1 to the functions / and / n , we have 

b b b 

(4) / f(x)dx- / f n (x)dx = 



At the same time, because of the uniform con- 
vergence of the sequence of functions /!,/ a , ... to the 
function /, there exists for a given e > a number fc 
such that \f(x) f n (x)\ < e for n > Tc. Hence, by (4), 8 
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and 7, we have 

6 b 

\ff(a>)dx-ff n (x)dx 



In this way we have proved that for n > k there 
holds the inequality 

6 6 

I f f 

J /(0)dte j f n (x)dx 



e\b a\ . 

This means that equation (3) is satisfied. 
As a corollary of Theorem 11 we have: 

b oo oo b 

a n=>0 w=0a 

assuming the functions f n to be continuous and the series 

00 

fn() to be uniformly convergent in the interval 
a <o? < b. 

EXAMPLES AND APPLICATIONS, (a) To evaluate the 

integral / (1 x 2 ) n dx, we substitute x = sintf. Then we 
o 

have = sinO, 1 = sin(7u/2). Thus (cf. 10.1, 5), 

1 TC/2 



IT/2 



( 



lim J cosna?do? = = lim J si 
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Indeed, substituting y = nx, we obtain 

? **? 

I co$nxdx = - I cosydy = - (sinnft sinwa) . 

a rca 

b 

Since |sinw& sinwa| < 2 , we have lim / cosn^ete = . 



n oo a 
b 



Analogously it is proved that lim / minxdx = 0. 

n~ oo a 

The following more general formula holds: 

6 b 

(Y) lim j f(x)c.o&nxdx = = lim J 



where / is an arbitrary continuous function. 

Let a number e > be given. According to the uniform 
continuity of the function / in the interval a < x < b 
there exists an m such that dividing the segment ab 
in m equal segments, to any pair of points x and x' be- 
longing to the very same from among these m segments 
the inequality \f(x) f(x')\ < e holds. Let a 1? a 2 , ..., a m _ x 
be the points of the division; moreover, let a Q = a, a m 6. 
By formula 5, we have 

b m a k 



j f(x)cosnxdx = ^ J f(x)cosnxdx 

k=~l a 1c _ l 
a k a k 

J cosnajcte+ J 



m a k 



Thus (cf. formula 8), 

b m 

i r v^ I c 

I f(x)o,osnxdx < > /( a fc)r I 

a ic=*l - 

because 
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Since, as we have proved, 
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cosnxdx 



1, 

- I 
n 



n 



so denoting by M the upper bound of the function \f(x)\ 
in the interval a < x < 6, we obtain 

b 

2 

S - Mm + s(b a) . 
n 



Whence choosing n so large that - Mm < e we have 

IV 



J 



Hence the first of the equations (y) follows. The proof 
of the second one is analogous. 

() If the indefinite integral of a given function is 
not known but this function may be expanded in a uni- 
formly convergent series of functions which we are able 
to integrate (e. g. in a power series), then the application 
of Theorem 12 makes it possible to express the definite 
integral by a series. 

In this way we shall calculate the elliptic integral 
(cf. 9.5, Eemark): 

7T/2 



I/I fc 2 
As we know (cf. 8.4): 



2 2-4 2-4-6 
Hence, replacing ^ by A; sin x we have: 

1 _ = 1 + - & 2 sin 2 #+ ft 4 sin 
2 2-4 

1 3 5 



-\ 



2.4-6 
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This series is uniformly convergent in the interval 
< x < 7T/2 (even on the whole X-axis), since the series 

representing . is uniformly convergent in the interval 

1/1 /2 
\ J. I 

|fc|<t<|fc|. Integrating term by term and applying 
the formula ((4) of 10.1) 

K/2 



_____._, 





we obtain 

7T/2 



fc 2 sin 2 x 



10.3. Definite integral as a limit of sums 

Now, we shall prove theorems which give important 
applications of the definite integral. 



1. Lei a continuous function y /(#), a < x < fe, 
a number e> be given. Then there exists a number 6 > 
possessing the following property: if the points a Q < % < 
< ... < a m , where a = a and a m = 6, satisfy the inequality 
ajcajc-i < d for each fc = 1, 2, ..., m and if the points 
x,...,x m are chosen from the intervals 
respectively (i.e. a k -i < afc < a&) 



Indeed, according to the uniform continuity of the 
function / in the interval a < x < 6 (cf. 6.4, 1) there 
exists a d > such that the condition \x x'\ < d implies 
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\f(x)-f(x')\ < j. By the formulae 5 and 9, 10.2, 
o a 

we have 

6 ai *% 

J f(x)dx = / f(x)dx + ...+ / i(x)dx 



... +i(x' m )(a m -a m ~i) 



where x k is a suitably chosen number in the interval a&-i ^ - 

Since the points x k and x' k belong to the interval 

^k-i a kj the distance between these points is not greater 

than the length of this interval, i.e. \x k ~x' k <% a^-i 5. 

g 
Hence it follows that \i(x k ) f(x k )\ < T . Consequently 



//* 

I 

/c=l 
m 



In this way Theorem 1 is proved. 

Now, let us consider instead of one partition of the 
segment ab (defined by the points a , a 15 ..., a m ), a se- 
quence of partitions of this segment in smaller segments. 
Let the n-th partition be defined by the points 

n,o, W , ... , a n ,i n , where a n>0 = a, a n , ln = fe . 

Let r n denote the length of the greatest segment of 
the n-ih partition. We say that the above sequence of par- 
titions is normal, if lim r n = 0. The following theorem holds: 
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2. Let a continuous function y = /(#), a < x < 6, 
a normal sequence of partitions of this segment be given. 
If the point x n>k belongs to the Jc-th interval of the n-th 
partition (i.e. a n>fc _! < x n>k < a n , k for Jc = 1, 2, ..., l n ; 

n = 1, 2, ...), tt^ 

(6) / /(0)<to - Mm j /(avi,fc)(n,*~n,*-i) 

Let an e > be given. We choose JV" in such a way 
that for n > N the inequality r n < d holds, i. e. that all 
intervals of the n-ih partition have the length < d (where 
d has the same meaning as in the previous theorem). 
Then by Theorem 1 we have 



In 



an,*-l) ~ J 



< 8 



This means that equality (6) is satisfied. 

It follows in particular that if all segments of the 
n-th partition are of the same length, namely, 2~ n (b a), 
then 

6 2 n 

f(x)dx = (b-a)lim2~ n V f(a n>k ). 



Eemark. The notation / ydx is closely related to 

a 

Theorem 2, so from the point of view of notions as from 
the historical point of view. The symbol /, the modified 
letter S, had to indicate the summation of infinitely 
many < 'infinitesimal" terms of the form ydx; this con- 
cept, which was not well-defined from the logical point 
of view, becomes now expressed strictly in Theorem 2. 
It is easily seen that this theorem represents the definite 
integral not as an infinite sum but as a limit of sums 
of an increasing number of terms. 

In 10.11 we shall turn to the definition of the integral 
based on formula (6). 
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10.4. The integral as an area 

Let i(x) > for a < x < b. 

b 

The integral / f(x)dx is the area of the region P con- 

a 

sisting of the points x, y of the plane satisfying the conditions: 
a^x^b, <#</(#). 

It is really so, when the function / is linear. Then 
the region P is a trapezoid the bases of which (parallel 
to the Y-axis) have the length /(a) and /(ft), respectively, 
and the hight has the length b a. Thus the area of the 

trapezoid is MM( fe _a). 

Zt 

On the other hand, the function / as a linear function 
is of the form f(x) cx + d. Hence 

b 



/ 



&>+*&>_.,, 



since f(a) =ca + d and f(b) = 

Thus we see that in the case when the function / 
is linear, the notion of the area known from the elementary 
geometry is equivalent to the above defined notion of the 
area as the definite integral. This equivalence holds also 
in a wider sense, if / is a polygonal function (cf. 6.4), 
i.e. when the graph of the function is a polygonal line. 
Namely, the region between this polygonal line and the 
X-axis consists of a certain number of trapczoids and 
hence its area is the sum of the areas of these trapezoids. 
Yet since, as we have stated above, the area of each of 
these trapczoids is a suitable integral, so the area of the 

b 

whole region is the sum of these integrals, i.e. / f(x)dx 

a 

(according to 10.2, 5). 

In the general case if / is an arbitrary continuous 
function, the function / is the limit of a uniformly con- 
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vergent sequence of polygonal functions (cf. 6.4): f(x) 
= \imf n (x). Hence, by 10.2, 11, 

noo 

b b 

J f(x)dx = lim J f n (x)dx . 

a n=oo a 

Then we see that the area of the region determined by the 

b 

curve y = j(x) (defined as the integral / j(x)dx) is the 

a 

limit of areas of polygons "inscribed" in this curve 
(cf. Fig. 10 in 6.4). 

Thus, there is here a complete analogy to the area 
of a circle, defined as the limit of areas of inscribed (or 
circumscribed) polygons. Similarly, we define the area of 
the region P given by the curve y /(#) as the integral 



Remark. This area could also be defined on the basis 
of the measure theory, which we shall not consider here. 
Then this definition could be proved to be equivalent to 
the definition of the area by means of the definite integral 
(we have performed such a proof in the most elementary 
case, namely, if / is linear or polygonal). 

EXAMPLES, (a) Let y = |/V 2 # 2 , r < x < r. We shall 

r 

calculate / |/V 2 x* dx. 

r 

For this purpose we shall find the indefinite integral. 

/Y 

Substituting z = ~ we obtain (cf. 9.3, 4) 



2 /I . x 1 #_ / i 
= r 2 -arc sin- + --!/ 1 
\2 r 2 r \ \ 

Hence 

r 

J]/r 2 x*d% = r2(^arcsinl-~|arcsin( 1)) 
~f 
since arcsinl = ^TT and arcsin( 1) = |TC. 
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In this way we have obtained the formula for the 
area of the semicircle with a radius r, known from ele- 
mentary geometry. 

((3) The area of the region contained between the arc 
of the parabola y = x 2 , the .X-axis and the straight line 

a 

x a is given by the integral / x 2 dx = Ja 3 . 

o 

x z y 2 
(y) The area of the ellipse + jr = 1 will be cal- 




culated as follows: the above equation gives y = b 1 / 1 -- - , 

a I -p 

whence the area of the ellipse is equal to 2b / 1/1 -- ^dx. 

a \ & 

Applying, similarly as in the example (a), the formula 
for the indefinite integral / j/1 z*dz we find 



a 

26 / 




X 

1 ~ 
a 2 



() The area between the sinusoid and the segment Or: 
on the X-axis is 



J sinxdx = [ COS^]Q = 2 . 



(e) Let two continuous functions u(x) and v(x) defined 
in the segment a<#<& be given. Moreover, let u(x) 
<v(x) for a < x < b. The region N contained between 
these two curves, i. e. the set of points #, y on the plane 
satisfying the conditions: 

a < x < b , u(x) < y < v(x) 
is called a normal region. 

b 

The area of the normal region N is / [v(x)-~ u(x)]dx. 

a 

Indeed, if u(x) > everywhere, then the region N is 
obtained from the region contained between the curve 
y = v(x) and the X-axis by subtraction of the region 
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contained between the curve y = u(x) and the X-axis; 

b 

the area of the first region is / v(x)dx and the area of 

a 
b 

the second one is / u(x)dx. Hence the area N is the 

a 

difference of these integrals. 

Now, if the inequality u(x) > does not hold for 
all x, then we denote by m the lower bound of the 
function u in the interval a < x < b and by N the normal 
region defined by the curves u(x) m and v(x) m. The 
region N is obtained from the region N by translation 
and so N Q is congruent to N. Thus, 

b 

area N = area N = J {[# (x) m] [u (x) m] } dx 

a 
b 

= J [y(x) u(x)]dx . 

a 

Eemarks. (a) Considering the area of the normal 
region it is meaningless whether we take its perimeter 
into account. Namely, we assume the perimeter to have 
the area 0. This follows from the fact that the curve 
y f(x) may be included in a normal region with an 
arbitrarily small area, namely, in the region contained 
between the arcs y = /(#) + and y = i(x) e; the area 
of this region is 2e(b a). 

(P) The symbol ydx is called the element of the area 
(cf. 7.13). 

6 

(y) The integral / f(x)dx may be interpreted as an 

a 

area also without the assumption f(x) > 0, if we agree 
upon considering the area of regions lying below the 
X-axis to be negative (where a < b). Thus, if the interval 
ab may be divided in smaller intervals in such a way 
that in everyone of these intervals the function is either 

b 

everywhere nonnegative or nonpositive, then J / (x) dx is 
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the algebraic sum of the areas defined by the arcs of 
the curve y = /(#), in each of these intervals separately. 
For example for the curve y = sin#, < x < 2?r, we 
divide the interval , 2-K into two halves. The sine curve 
together with the interval , TC of the X-axis gives a region 
with an area 2 and together with the interval TU, 2jc, 
a region with an area 2. The algebraic sum of these 
areas equals 0, i.e. 



J smxdx = , 



(8) Interpreting the definite integral as an area, many 
of the previously proved theorems become of a clear 
geometrical content (especially, if the function under the 
sign of the integral is nonnegative); e.g. Theorem 9 
of 10.2 means that the region defined by the arc?/ = /(a?), 
a < x < b, the X-axis and the perpendicular segments 
lying on the straight lines x = a and x = b has the same 
area as a rectangle having the segment a < x < b as the 
base and the ordinate of a suitable chosen point on the 
arc?/ = /(#), a < x < />, as the height. 

It follows from Theorem 10, of 10.2 (cf. remark 
that the area of a region defined by the arc?/ 
a < x < x', varies continuously together with x'. 

Theorem 11 of 10.2 means that if the functions f n 
are uniformly convergent in an interval ab to a function /, 
then the areas of the regions defined by f n are convergent 
to the area of the region defined by /. 

10.5. The length of an arc 

Let a function y = /(a?), a < x < 6, having a continuous 
derivative /'(a?) be given. The integral 






16 
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gives the length of the arc formed by the points x, y 
satisfying the conditions 

(8) y=/(a), a^x^b. 

It is indeed so, if / is a linear function, i.e. if the 
considered curve is a segment joining the points [a, /(a)] 
and [&,/(&)]. The length of the segment is equal to the 
distance of its ends, i.e. 



Applying the integral we obtain the same result, 
Namely, let us write f(x) cx + d. Hence f(c) = c. Thus, 

b 



a 

since 



G = 



b-a 



In the general case (if we do not assume the linearity 
of the function /) we find the explanation of the above 
assumed definition of the length of an arc in the following 
construction. 

We know (cf. 6.4) that an arc of a curve given by 
the conditions (8) may be approximated by polygonal 
lines inscribed in this arc (cf. 6.4, Fig. 10). Now, we 
shall prove that, denoting by L the length of this arc 
expressed by the integral (7) and by L 19 L 2 , ... the length 
of the successive polygonal lines, we have 

L = lim L n . 

n=-oo 

Namely, let the n-th polygonal line be obtained by join- 
ing the pOlIltS [> n , , /(n,o)L On,l, /(n,l)L -> l>Wn? f( a n,l n )] 

by segments, successively, where a n>Q = a, a n j n = b and 
the length of the greatest interval of the n-ih partition 
tends to as n tends to oo (i.e. the sequence of these 
partitions is normal in the sense of 10.3). The length 
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of the n-ih polygonal line is the sum of the length of 
the particular segments, which constitute this polygonal 
line, i.e. 

In 



Applying the mean-value theorem we obtain 

i n __ 

Ln = ^ (Om*-0n,*-l) V'l + tf'teri,*)] 2 , 
fc=i 

where 0^-1 < x n ,k 
Hence by Theorem 2 of 10.3 (formula (6)), we conclude 
after substituting I/ 1 + [/'(#)? in place of the function /(#) 
that 

b 

f 1/TWMP * = lim = i . 

^ n-oo 

The remarks noted in the case of the definition of 
the area are valid in the case of the definition of the 
length of an arc, too. The notion of the length of a curve 
may be defined on the basis of the general measure theory 
and it may be proved that for arcs of the form (8) this 
definition is consistent with the definition given here by 
means of the integral (7). However, since we do not use 
here the measure theory, we define the length of the arc 
(8) as equal to the integral (7). 

The approximation of the length of an arc by the 
length of inscribed polygonal lines which we have con- 
sidered above is the generalization of the approximation 
of the length of a circumference by the perimeters of 
the inscribed polygons, known from the elementary geo- 
metry. We shall prove that the length of an arc of the 
circle in the sense of elementary geometry is equal to 
the length in the sense of the definition assumed here. 

EXAMPLE. Let y = j/V 2 # 2 , rcos/? < x < rcosa (Q < a 
< /3 < n). The considered arc is a part of the semicircle 
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with the radius r and the centre 0. Let us calculate the 
integral (7). We have 

x , r , r rdx 

y = -7===, whence i/l + (y') z dx = / 

j/r 2 -^ 2 ' J V^W> J y r *-x* 

Substituting x = rcost we find 

rdx ^ x 

= rt = rarccos-. 



l/A2 /y2 y 

Hence 



r COB ft 

in accordance with the formula known from elementary 
geometry. 

Let us write 



The function s(x), i.e. the length of the arc treated 
as a function of the abscissa of the right (varying) end 
of the arc is an increasing function. Thus, there exists 
a function x = x(s) inverse to s(x), which represents x 
as a function of the length of the arc. There hold the 
formulae: 



Denoting by a the angle between the tangent to the 

curve and the X-axis, we have -- = tana and so -j- 

7 dx ds 

= cos a. This means that the derivative is the direction 
cosine of the tangent to the curve y = f(x) with respect 
to the X-axis. 

This follows also from the fact that 

dy dy dx , . - i w ^ \ , / ^ / \ 

-j- = - == tan a cos a = sina and | ) +1-^1 = 
as ax as 
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Bemark. The "length element" may be symbolically 
represented analogously to the Pythagorean formula: 
ds* = dx 2 + dy*, being of a clear geometrical content (cf . the 
notion of the differential, 7.13). 

The curvature. Let us denote as previously by a 
the angle between the tangent and the X-axis. This angle 
is a function of #; considering x as a function of the 
length s we express a as a function a(s) of the variable 8. 



The derivative & = 




as 



is called the curvature of the 




FIG. 23 



curve y = f(x) at a given point, the inversion p=- f = Q is 

\lc\ 

called the radius of curvature. 

Geometrically, the curvature fc is interpreted as follows: 
Let us draw the tangents to the considered curve at 

the points 

Po = I> (*o) 9 V (o)] and p h = [0 (* + h) , t/ (* + fc)] . 

The angles between these tangents and the positive di- 
rection of the X-axis are a = a(s Q ) and a h = a(SQ + h), 
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respectively. The angle d^ between these two tangents is 
a/i OQ. This is the same angle as the angle between 
the normals to the curve at the points p Q and p h . Let 
us consider the quotient of this angle by the length of 
the arcpoP/ij ie. by h. The curvature of the curve y f(x) 
at the point p is the limit of this quotient as h tends to 0. 
In particular, if our curve is an arc of the circle 
y = j/V 2 x 2 , r < # < r, then h = rd^ and so the con- 
sidered quotient has the constant value . Thus the 

same value has the curvature fc, and the radius of the 
curvature is equal to the radius of the circle. 

In the case of a straight line the normals are parallel. 
Thus dh = always and the curvature is equal to 0; hence 
the radius of the curvature is infinite. 

If it ^ 0, then the point lying on the normal in the 
distance Q from the point p Q on the same side of the tangent 
on which the curve lies locally, is called the centre of 
curvature. We may prove that this point is the limit 
position to which the point of the intersection of the 
normals at the points p Q and p h tends as h tends to 0. 

The curvature k may be expressed in the coordinates x 

and y as follows. Taking into account that a = arctan(-p) 
and basing on formula (9) we obtain 



da _ da dx dx- 

ds dx ds 

1 + 

i.e. 



NDT 



The centre of mass. Let a system of n material 
points with the coordinates (x l9 #1), ..., (x n , y n ) and with 
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the masses m ly ..., m n be given on the plane. The centre 
of mass of this system is the point with the coordinates 



To define the centre of mass of an arcj/ = /(#), 
a < oo < fe, with a constant density g we proceed as follows. 
Let us represent a? as a function of the length s, i.e. x = x(s) 
(as above); hence y = /[#($)] = y(s). Let $ denote the 
length of the arcj/ = /(#), a < a? < ft. Let us divide this 
arc into n equal parts. This division constitutes a partition 
of the interval 0$ into n equal intervals; let the points 
of the partition be 

= S nt Q , 8 Ut i , ... , S ntn = $ . 

The point with the coordinates #(* nv *)> ^(^n,A;) is the 
end of the fc-th arc of the n-th partition; the mass of 
this arc corresponds to this point. This mass is the product 
of the density by the length of the arc, i.e. it is equal to 
g m (8n,k s n,fc-i)' Thus given n, the centre of mass of the 
system of points 



is the point with the coordinates 



since the mass of the arc is equal to gS. 

The limit position of the point (x nj y n ) as n tends 
to oo is the position of the centre of mass of the con- 
sidered arc. Thus the coordinates of the centre of mass are 

s s 

1 f _ 1 f -T 

(12) x = limx n = -~ xds and y = lim y n = -~ 2/a^ . 

n-oo ^^ n=oo AJ 
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10.6. The volume and surface area of a solid of revolution 

Let a continuous function y = /(#), a < x < &, be given. 
Moreover, let j(x) > 0. Let us denote as in 10.4 by P 
the region constituted by points x, y satisfying the con- 
ditions a < x < 6, <?/</(#). Eotating the region P 
around the JC-axis we obtain a solid of revolution. Let 
us denote its volume by W. We have 

b 

(13) W = - 

In order to explain -this formula, let us consider 
a normal sequence of partitions (see 10.3, 2). Let 




FIG. 24 

f(n,k) be the upper bound of the function / in the 
interval a n ,fc-i? &n,&- Replacing the arc of our curve lying 
over this interval by the segment y = f(x n ,k) we obtain 
by the rotation around the X-axis a cylinder with the 
base 7c/(o? n ,&) 2 and with the height (i n> k ^n t k-u an< i 80 
with the volume 



Proceeding in this way for each Tc (n being constant) 
we replace the considered solid of revolution by another 
one, circumscribed on the given solid and made up of 
a certain number of cylinders. The volume of this solid 
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is the sum of the volumes of the particular cylinders: 
denoting this volume by TF n , we have then 



By Theorem 2 of 10.3 we obtain in the limit 

W = lim W n . 

Analogously, replacing the upper bound by the lower 
bound in the above construction we prove that W is 
the limit of the volumes of certain solids inscribed in 
the considered solid of revolution everyone of which is 
a sum of a certain number of cylinders. 

Let us denote by B the area of the surface obtained 
by the rotation of the arcy /(a?), a < x < ft, i.e. the 
area of the lateral surface of the considered solid of revo- 
lution. We have the formula 



(14)1 B = 2 

a 

(assuming the continuity of the derivative 

To establish this formula we approximate the con- 
sidered surface by surfaces the area of which is known 
from the elementary geometry. For this purpose let us 
consider a sequence of polygonal lines approximating the 
arci/ = /(a?), a < x < 6, defined in 10.5 (cf. Fig. 10). 
The surface obtained by the rotation of such a polygonal 
line around the X-axis constitutes of a finite number of 
truncated cones. Since the generator of a truncated cone 
is the segment joining the points l> n ,A;-i? /(,*-i)] 
[<Vfcj /(n,fc)], i.e. a segment of the length 



and the radii of the bases are of the length /(a n ,&) 
/(fln,fc-i)j respectively, so the area of its lateral surface 
is equal to 



250 IV. INTEGRAL CALCULUS 

as follows from a formula known from elementary 
geometry. 

Hence, denoting by B n the area of the surface obtained 
by the rotation of the n-th polygonal line, we get 



fc-1 



where a Utk -i ^ x Utk ^ a n>k . 
We shall prove that 

(15) B = lim E n . 



For this purpose let us compare B n with 

In 

C n = 27C 



By Theorem 2 of 10.3 with the function /(#) replaced by 
the product j(x) - ]/l + [/'(a?)] 2 we conclude that B = lim C w . 

noo 

Thus it remains to prove that lim (B n C n ) = 0. 

n=-oo 

Now, 



According to the assumption that the considered sequence 
of partitions of the interval of integration is a normal 
one we may assume that if the points x and x' belong 
to the same interval of the n-th partition, then | /(#) /(#')! 
< e (where e is a given positive number). Thus 



< e and | /(an,*) -/tea) I < 
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Denoting by M the upper bound of the function 
1/1 + [/'(#)? in the interval ab we obtain immediately 
\B n -C n \ < 2nsM(b-a). Hence lim (B n -C n ) = 0. 

71 = 00 

In this way the formula (15) is proved. 

A simpler formula for the surface of a solid of re- 
volution is obtained treating a? as a function of the length 
of the arc, similarly as in 10.5. Namely, applying the 
first of equalities (9) we have 

6 S 

(16) B = 27r / yyi+W)*dx = 2n f yds , 



where 8 denotes the length of the arcy = /(#), a < x < b. 
Formula (16) may be transformed as follows: 



(17) B = 8-2n 

6 

where y denotes the ordinate of the centre of mass of 
the arcy = f(x), a < x < b (cf. (12)). 

In other words, the area of the surface obtained by 
a rotation of the arc y f(x) around the X-axis is the product 
of the length of this arc and the path of the centre of mass 
(Guldin's theorem). 

EXAMPLES, (a) A cylinder. Let f(x) be of a constant 
value r for < x < h. The region P constituted by the 
points #, y such that < x < h and < y < r is a rec- 
tangle. By a full rotation of this rectangle around the 
JC-axis, a cylinder with the height h and with the radius 
of the base r is obtained. Hence the volume of this 
cylinder is equal to 7rr 2 A. The same result will be obtained 
applying formula (13), since 
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The formula (14) gives for the lateral surface of 
the cylinder (taking into account that y' = 0) the formula 

h 

B = 27i rdx = 2 



in accordance with the known formula from geometry. 
((3) A cone. Let y = cx 9 < x < "h. In this case the 
region P is a triangle. By the rotation, a cone with the 
height h and with the radius of the base r = ch is obtained. 
By formula (13) the volume of this cone is equal to 

h 

TT J (PaPdx - JTCCW - J7cr 2 fe . 



According to formula (14) the lateral surface of the cone 
is equal to 

h 

2-Tt J 



ex 

o 

/ 

where Z denotes the length of the generator (because 
Z = 



(y) A sphere. Let y = ]/r 2 # 2 , r^x^r. The set 
of points defined by these conditions is a semicircle. 
Rotating the semicircle around the JT-axis we obtain 
a sphere with the radius r. The volume of this sphere is 

r r r 

7i J (r 2 x*)dx = 7i j r 2 dx 7t f x 2 dx = 27rr 3 |7ir 3 = frcr 3 . 

r r r 

To evaluate the surface of the sphere, formula (16) 
may be applied. For this purpose we express y as a func- 

o 

tion of the length of the arc s, i.e. y = rsin-. We obtain 
the following value of the surface of the sphere: 

rtr TT 

2n j rsin^ds = 2^ J smtdt = 
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10.7. Two mean-value theorems 

FIRST THEOREM. Let two continuous functions f and 
g be given in an interval a < x < b. Moreover, let the 
function g be of a constant sign. Then 

b b 

(18) ff(x)g(x)dx = J(t)fg(x)dx, 

a a 

where f is a suitable chosen value satisfying the condition 
a < f < &. 

Indeed, let m and M indicate the lower and the upper 
bound of the function / in the interval a < x < fc, 
respectively. Then we have 

m </(#) < M 
for every x. 

Let us assume that g(x) > everywhere. Multiplying 
the above double inequality by g(x) we obtain then 

mg(x) ^f(x)g(x) <Mg(x) 
and hence, by integration (cf. 10.2, 7), 

? ? 6 

m I g(x)dx < J f(x)g(x)dx < M J g(x)dx. 

a a a 

Hence we conclude (assuming the function g to be 
not identically equal to 0, which can be obviously sup- 
posed) that 

b b 

m < | J f(x)g(x)dx: J g(x)dx} < M . 

a a 

According to the Darboux property of the function / 
(which is a consequence of its continuity), this function 
assumes all values contained between m and M. Therefore 
there exists a f in the interval ab such that 

b b 



i.e. that formula (18) is satisfied. 



254 IV. INTEGRAL CALCULUS 

In the case when g(x) < everywhere, the proof is 
completely analogous. 

Be mark. Assuming that g(x) ^ 0, always we obtain 
a shorter proof of the above theorem applying the Cauchy 
theorem stated in 7.5, (12). Let us denote by H(x) the 
primitive function of the function 1(x)g(x) and by G(x) 
the primitive function of the function g(x). Then we have 



6 6 

f(x)g(x)dx = H(b)-H(a) , / g(x)dx = G(b)-G(a) . 

a 

By the Cauchy theorem, 

g(ft)-g(g) !T(f) 
G(b)~G(a) Q'(g) ~ 

and formula (18) follows. 

SECOND THEOREM. // the function f is continuous and 
the function g is monotone and possesses the second 
derivative continuous in the interval a < x < fe, then 

b b 

c c c 

(19) J f(x)g(x)dx g(a) j f(x)dx + g(b) J f(x)dx, 

a a 

where is a suitable chosen value belonging to the interval ab. 
Let us denote by F(x) a primitive function of the 
function /(#), i.e. F'(x) = f(x). Since the derivative of 
a monotone function is of a constant sign (cf. Theorem 2 
of 7.7), so we may apply the first mean- value theorem 
to the product of the functions F(x) and g'(x). Hence, 
applying the rule for integration by parts, we obtain 

66 6 



<i)-l-F() f 



b 



since f g'(x)dx = g(b) g(a) 
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Consequently, 

b 

f(x)g(ai)dx = g(a)tF(!)-F(a)] + g(b)[F(b)-F(t)-] , 

whence we obtain formula (19) taking into account that 

* b 

F()-F(a) = J f(x)dx and F(b)-F() = f f(x)dx . 

a $ 

EXAMPLES AND APPLICATIONS. The mean-value theorems 
are often applied in order to estimate the value of integrals. 
We shall consider some of their applications. 

(a) Let < a < b. We shall prove that 

6 

sin wo? 



(20) lim f - 

n==oo ^ 



00 / 0? 

a 



For this purpose we shall prove that 

b 

4 



/m\ I f sin 00 , 

(21) \j--dx 



< --, if c> . 



We apply the second mean- value theorem substituting 
f(x) = sin oo? and g(x) = l/o?. We obtain 



? ? ? 

f sin co? , If- jj , 1 / 
- - ax - sinoo?ao? + - s 
J # a J & J 



1 1 

= (cos ca cos c) + -r- (cos cE cos co) . 
ao bo 

Since |cos/| < 1 and a < ft, we conclude that 

b 

" sin co? n 



0? 



. 

be ao 



The formula (21) implies the formula (20) immediately. 

Eemark. The formula (20) is also an immediate con- 
sequence of the formula (y) in 10.2. 

(P) Applying the first mean- value theorem, the Taylor 
formula may be deduced in the following way. 
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We substitute in the formula 



+ (-ip 

proved in 9.3, 5, (y), z = (6 #) n , # = /(#)? assuming the 
function / to possess a continuous n+l-th derivative in 
the interval a < x < 6. 

Integrating from a to ft we obtain 

6 

^ 

On the other hand, the function (b x) n being of 
a constant sign in the interval a < x < 6, we obtain by 
the first mean-value theorem 



r 

J (*- 






Comparing the obtained formulae we get the Taylor 
formula with the remainder in the Lagrange-form. 

10.8. Methods of approximate integrations. Lagrange inter- 
polation 

Given n+I points # , x 19 ... , x n on the X-axis and n+I 
values 2/oj ?/u ? 2/nj there may be defined a polynomial 
w(x) of the n-th degree assuming at these points the 
values 2/ , y ly ..., y nj i.e. such that 

(22) w(x k )=y k for i = 0,1, ...,. 

First we shall define for each Tc a polynomial u k (x) 
of n-ih degree with the property that u k (x k ) = 1 and 
= for each m ^lc. 



10. DEFINITE INTEGRALS 257 

Namely, we write 

u xv = (x-x )-...-(x-x k 
k{ -> ' 



...-(x k x n ) ' 

By means of the polynomials Uk(x), we define the 
polynomial w(x): 

(23) w(x) = y u (x) + y 1 u l (x) + . 



We see at once that this is a polynomial of the n-th 
degree, satisfying the condition (22). This is the so called 
Lagrange interpolation polynomial. 

It is worth while noting that the polynomial w(x) is 
determined uniquely, i.e. if a polynomial w of n-th degree 
satisfies the condition (22), too, then it is identical with w] 
for their difference is a polynomial of degree <n vanishing 
at n+1 points (namely, at the points # , x l9 ..., x n ). 

When a function expressing a relation between certain 
physical quantities is known only in an empirical way, 
i.e. if only a finite number of values of this function 
(by means of measurements) is known, then an ap- 
proximate evaluation of the integral of this function is 
applied, e.g. the Lagrange interpolation, and then the 
integral of the obtained polynomial is evaluated. 

We obtain an especially simple formula if n = 2 and 

x = a, x = - , # 2 = b, i.e. when we draw a parabola 

2 

through the given three points. As can be easily calculated, 
we obtain 

b 

-~( 



(24) J 



This is the Simpson foimula giving an approximate 

b 

value of the integral f f(x) dx. The approximation will 

a 

become more accurate if we divide the interval ab into 
smaller intervals and if we apply the Simpson formula 
to everyone of them. Namely, dividing the interval ab 

17 
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into 2n equal intervals by means of points # , # 1? ... 
where X Q = a, x 2n = b, we obtain the general Simpson 
formula for the approximate value of an integral: 



EXAMPLE. Let us apply the Simpson formula to evaluate 

cdx 

log 2 / , dividing the interval 1 < x < 2 into halves. 
i a/ 

We have 

#o = l, 3/0 = 1, #! = 1.5, 2/! = 0.667... , 

# 2 = 2 , y 2 = 0.5 . 

Thus formula (24) gives the approximate value of log 2: 
-0.667 + 0.5) = 0.694... 



Actually, we have Iog2 = 0.6931... 

Now we shall mention the so called "trapezoid method" 
of the approximate evaluation of the integral of a func- 
tion f(x) > in an interval ab. We divide the interval ab 
into n equal intervals by the points X Q < x < ... < oc n , 
where x = a, x n = b and we draw a polygonal line through 
the points (#&,2//e), where & = 0, 1, ..., n (cf. Fig. 10). 
The area s n between this polygonal line and the X-axis 
is the sum of areas of n trapezoids T 1? ..., T nj where the 

area of the trapezoid T& is equal to 
Thus, 

_ b a 
n ~~ n 

This is the approximate value of the area between 
the curve y = /(#), a < x < ft, and the X-axis; speaking 
otherwise, this is the approximate value of the integral 

6 

Sf(x)dx. 
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10.9. Wallis formula Q) 

We shall prove the following formula: 

,orx r */ 2-4-...-2n \ 2 

(25) 7u - lim - ^ - - . 

n s =oo^\l-3.....(2n-l)/ 

We shall base our proof on the formulae 

TC/2 

/' . 2n , l-3-....(2n-l) TT 
sin 2n a?dte = o-i ^ - o ? 
J 2-4-...-2w 2' 

o 

7T/2 



(' si 
J si 



proved in 10.1, 5. 

From these formulae it follows: 
(26) 

7T/2 TT/2 



We shall prove that 

7T/2 n/2 

i C C 

lim i J sin^xdx: J 

n=oo Q 

Indeed, in the interval < x < n/2 we have the 
inequalities 

whence 

Tt/2 7T/2 7T/2 



and so 

r r 

1<J mi^xdx: J si 



TT/2 7T/2 

< ( sin 2 ^- 1 ^^: i sin^+^dte < ^! + = 1 + . 
J J 2n 2n 



(*) John Wallis (1616-1703), an English mathematician. 
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Thus the considered quotient of integrals tends in the 
limit to 1. 

Hence we conclude by (26) that 

TT '/ 2- 

< 27) 



This formula gives formula (25) immediately, since 
n 1 



Bemarks. (a) We apply the Wallis formula also in 
the following form:] 

(28) J/TC = 

Namely, we have 

1-2- ...-2n __ (2n)l 
2-4-...-2n n\-2 n ' 

Substituting the above formulae in formula (25) and 
taking a square root we obtain equality (28). 

((3) The Wallis formula may be written also in the 
form of an infinite product: 

n - n 4 ^ 2 ??*!_- 

2 1 1 4n 2 -l ~ l'3'3'5'5V"' 

n=l 

Namely, denoting by p n the partial product 

4>12 4n 2 _ /2 2\ / 2n 2n \ 

Pn ~"4-l 2 l'""'4^ 2 -l ~ \I'3/ *" \2n-I '2n+I/ 



-3-...-(2n-l)/ 2n+l' 
we have, according to (27), lim p = 5 At the same time 



whence the formula (29) follows. 
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10.10. Stirling formula C) 

We shall deduce from the Wallis formula the following 
formula due to Stirling: 

(30) lim , ?' 1 . 

n=ooj/27m^6T- n 

Let us write 

n\e n 



n n ]/n 
So it is to be proved that lim a n = |/27c. 

n=oo 

First we shall prove the sequence a l7 a a , ... to be 
convergent. Since it is a sequence of positive terms, it 
suffices to prove that this sequence is decreasing, i.e. that 

> 1. Now, 



a n 1 (n+l) n+1 + 1/2 1 / iyn-i/2 
~ e \ + n) ' 



whence 



Since (cf. 7, (54)) 



for < a? < 1, so substituting a? = - we find 



whence > 1 . 



Thus, the sequence a 1? a 2 , ... is convergent. Let us 
write lim a n = flf. We shall prove that g ^ 0. 



James Stirling (1692-1770) noted Scottish mathematician. 
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For this purpose let us note that 



ri+l 



i\ r <fo i /i i \ 



since the arc of the hyperbola y = - , n^x^n +1, lies be- 

30 

low the segment joining the points I n , - 1 and I n +1 , , I . 

\ n] \ n+j 



Hence 



log < T , i.e. a rl >e 8 /*. 

a n 4: 



and so 



It remains for us to prove that g = 2^. To this 
end we now apply formula (28) taking into account the 
equations 



^ = ^. j ^ 1 _ and 



n 2 w 

We obtain 



2 02 

= lim - 2-7= = ^ i.e. 



Remark. The practical importance of the Stirling 
formula is based on the fact that for large values of n 
the expression \/2nnn n e~~ n gives an approximate value 
of n\. We say that it is an asymptotic value of nl (which 
means that the quotient of these two expressions tends 
to 1). 

10.11*. Riemann integral. Upper and lower Darboux 
integrals 

The theorems of 10.3 are the starting point for 
a generalization of the notion of a definite integral to 
certain classes of discontinuous functions. For this purpose 
we shall introduce the Darboux integrals. 
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Let a bounded (but not necessarily continuous) func- 
tion y = /(a?), a < x < 6, be given. Moreover, let a sequence 
of partitions of the interval ab into 2 n equal parts 
(n = 0, 1, ...) be given. Let us denote the points of the 
n-ih partition by 

n,o , #n,i , , ^n,2 w , where a Wj0 = a , ^,2** = 6 . 
Let M Htk denote the upper bound of the function / 
in the interval a n ,/c-i <*<n,k Finally, let 

2* 

(31) $ n = y^ ^*n,fc 

fc-1 

The sequence {$ n } is a decreasing sequence (in the 
wider sense). Indeed, for each ~k = 1, 2, ..., n the intervals 
#+i,2fc-2*Wi,2fe-i a ^d ^n+i,2A:-i tt Ti-fi,2A; are contained in the 
interval Oo^-i a n ,& . Thus, 



i.e. 
Hence 



2 ~ - ~~ 2 

Thus the sequence {S n } is non-increasing. It is simul- 
taneously a bounded sequence, since, denoting by m 
the lower bound of the function /, we have obviously 
8 n ^m(b a). Hence it is a convergent sequence. Its limit 
is called the upper Darboux integral and denoted by 
the symbol 

6 

(32) 

Similarly, denoting by m nt jc the lower bound of the 
function / in the interval a n , fc ~i^n,fc and writing 

, 2W 

b a v~i 

(33) s n = -^r 2j 

/c-l 
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we prove the sequence {s n } to be increasing (in the wider 
sense) and bounded, and so convergent. Its limit is called 
the lower Darboux integral and is denoted by the symbol 



(34) / i(x)dx lim 



If the upper and lower integrals are equal, then the 
function / is said to be integrable in the Riemann sense; 
the common value of these two integrals is called the 
Riemann integral of the function f and is denoted by 

6 

/ f(x)dx as in the case of the definite integral of a con- 

a 

tinuous function. The same symbology may be applied, 
because (as follows from the theorem 2 of 10.3 im- 
mediately) the Riemann integral of a continuous function 
is equal to the definite integral of this function (in the sense 
of the definition giA^eii in 10.1). 

The functions integrable in the sense of Eiemann 
consist of a larger class of functions than the continuous 
functions. In particular, bounded functions having a finite 
number of points of discontinuity (we shall turn to such 
functions in 11) and monotone functions are integrable. 
However, there exist (bounded) functions nonintegrable 
in the sense of Eiemann. An example of such a function 
is the Dirichlet function which we have already met 
(cf. 4, 5), equal to 1 in rational points and to in ir- 
rational points; for this function we have always S n = 1 
and s n = and so 

b b 

/ i(x)dx = 1 , J i(x)dx = . 

a a 

Let us add that there exists a definition of the 
(Lebesgue) integral which ascribes the integral to a larger 
class of functions than the Eiemann integral ( x ). 



(*) Cf. S. Saks, Theory of the Integral, Monografie Matema- 
tyczne, vol. 7 (1937). 



10. DEFINITE INTEGRALS 265 

We based tlie definition of the Darboux integrals on 
the consideration of a sequence of the "diadic" partitions 
of the interval of integration. We shall now show that 
the same result is obtained considering an arbitrary normal 
sequence of partitions. More strictly, we shall prove the 
following theorem: 

Let a normal sequence of partitions of a segment ab 
defined by the points 

(35) < < <i < ... < <z , where 



be given. Let M^ k denote the upper bound of the function f 
in the interval a,nk-iUn,k an d let 



(36) 8' n = M' ntk (a' ntk - 

k~l 

Then 

b 

(37) limS'n = J f(x)dx. 

n~oo a 

The proof of this theorem will be based on the follow- 
ing lemma: 

Let two partitions of the interval ab, 

a = a < a l < ... <a r = b and a = aj < a[ < ... < a^ = b 

be given. Let d and A' indicate the length of the greatest 
interval of the first or of the second partition, respectively. 
Let M k and M k denote the upper bounds of the function f 
in the intervals a k -ia k or a' k -ia' k , respectively, and let 



(38) S = M k (a k ^a k ^) and S' = 



Finally, let the number M satisfy the inequality M> \f(oo) 
for every x belonging to the interval ab. 
Then the relation 

(39) S' 

holds. 
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The intervals of the second partition may be classified 
in r+1 classes; a given interval of this partition will 
belong to the fc-th class (for fc = 1, 2, ..., r), if it is con- 
tained in the interval a k -id k and to the r+l-th class, 
if it is contained in none of the intervals of the first 
partition, i.e. if it contains inside one of the points 
a 1? 2 , ..., a r -i. It is clear that some of these classes may 
be empty. 

If the fc-th class (for k ^r) is non-empty, then let 
p k denote the first and j k the last index i satisfying the 
condition a k -\ < a'i < a k . Since for the intervals a^i aj of 
the &-th class there holds the inequality Mi ^ M k , so 
denoting by ^ k the sum over all intervals of the &-th 
class we have 

ftfaJ-nf--!) < M k ^ k (a' i -a f i . l ] = M k (a' ik - a' Pk ) 
M^ak-a^^M^a'^ 
M k (a k a k -i 



If the A-th class is empty, then let ]? k = 0. Finally 
let us note that there are at most r 1 intervals of the 
y+l-th class. Thus, 



Consequently, 



,- a ) + ... 



whence the formula (39) follows. 
Thus our lemma is proved. 

In order to prove the theorem let us consider an e > 

I 
and let us choose an index q such that $ a < / f(x) dx + e. 

a 

Since the considered sequence of partitions is normal, 
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we have d' n < - - for sufficiently large n. Hence, 

3 2 Ju. 
according to the lemma, we have 

b 

f(x) dx + 2e . 

Moreover, let us choose to each n an index j n such 
that the inequality -^r~ < ^Tlvf holds - 

A' n ol n JXL 



whence 

6 b 

J f(x)dx < S' n + e , because J f(x)dx < 8j H . 

a CL 

Consequently, 

5 S 

f f(x)dx <S' n + e < f f(x)dx + 3e. 

a a 

The number e being arbitrary, this inequality implies 
formula (37). 

Thus, our theorem is completely proved. There is 
a similar theorem for the lower integral. 

The following formula is an important consequence of 
our theorem: 

6 c b 

J f(x)dx = / 1(x)dx+ / f(x)dx, 



a c 



f(x)dx = f f(x)dx+ f f(x)dx, 



a 



if a < c < b. 

Indeed, let us divide the segments ac and cb into 2 n 
equal parts. Let us denote the points of the partition by 

(41) a = a w , < n ,l < .- < #n,2 w = == 



268 IV. INTEGRAL CALCULUS 

Let M n>k denote the upper bound of the function / 
in the interval a n , k -ia ntk and P U)k the upper bound in 
the interval b n , k -ib njk . Then we have 

C 2 n 

J f(x)dx lim 

a "-<. i 

and 

b 2 n 

/ f(x)dx = lim y 
c -*-i 

Moreover, 



2 n 



since the points (41) define a normal sequence of partitions 
of the segment ab. Hence the first of the formulae (40) 
follows. The proof of the second one is analogous. 

It follows from the formulae (40) that if the function / 
is integrable in the intervals ac and cb (where a < c < b), 
then it is also integrable in the interval ab and the for- 
mula 5 of 10.2 (on the division of the interval of in- 
tegration) holds. 

Conversely, if a function f(x) is integrable in the 
interval ab, then it is also integrable in both intervals ac 
and cb (and so in each interval contained in aft, too). 

Indeed, we have by the assumption 



f f(x)dx = //(0)<te = f f(x 



Comparing this pair of equations with the formulae (40) 
we obtain 

c c 66 

(/ f(x)dx- / f(x)dx) + ( / f(x)*x- f /()*) = . 
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Hence we conclude by the obvious inequalities 

c ~ b I 

/ i(x)dx < / i(x)dx , / i(x)dx < / i(x)dx 

a a c c 

that 

c c 66 

/ i(x)dx = / i(x)dx and / i(x)dx = ff(x)dx. 

a a c c 

Just as for continuous functions we assume the for- 
mulae (2) and (3) for arbitrary integrable functions and 
we prove theorems 1, 2, 6, 7 and 8 of 10.2. In place 
of the mean-value theorem we have for arbitrary integrable 
functions the double inequality 

6 

(42) m(b-a) < / f(x)dx < M (b-a) , 

a 

where a < b and where M and m denote the upper bound 
and the lower lound of the function / in the interval ab 
respectively. 

Theorem 10 of 10.2 on the differentiability of the 

X 

function g(x) = j f(x)dx does not hold for arbitrary in- 

a 

tegrable functions. However, it may be proved that the 
function g(x) is continuous. 

Indeed, denoting by M the upper bound of the func- 
tion | /(a?) | in the interval ab we have (by the formulae (40) 
and (42)): 

X+h 



-g(x)\ = \f f(t)dt- f f(t)dt 



a 
x+h 



= IJ /(*)* 

X 

whence limg(x + h) = g(x). 
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Exercises on 10 

rr/2 7T/2 

1. Prove that J cos n xdx = / sin n #&. 





r T-I 1 x -cu 1 /tl\ 1 /M\ . 1 ln\ , 1 M\ 

2. Evaluate the sum - ( Q ) - - (J + g ( 2 ) - ... ^+1 (J 
mtf: apply the substitution x = costf to the integral 



3. Deduce the (Cavalieri) formula 

1 

lim - 



" +1 



1 



applying the integral / x m dx (cf. also Exercises 2 and 3 
of 1). 

4. Evaluate lim n ( " + ... + -^- ^j (integrating the 

n=oo \W ~rJ- n -\- n J 



function - ). 



5. Prove that limf-^ +-^ + - + ^1 = Iog2. 

ns=00 \n+l n + 2 2w/ & 

6. Give a geometrical interpretation of the Euler con- 

stant (cf. 7, Example 18) C - lim (l+ i+ - + ...H --- 

w=oo \ 2 o n 

log ^ ), applying the equation / = logn. 
/ i x 



rr -r* J.T_ ^. r ^sno? _ 7i ^ ,. 

7. Prove that I - - r- ao? = . Decompose the in- 

o l + cos 2 a? 4 ^ 

terval of integration into halves and substitute in the 
second integral x = n t. 

f 7T 

8. Prove that J logsin^dte = -.Iog2. (First prove that 

o * 



7t2 ^ 7i2 airi2ir 

= / logcos#do? = - / log - dx). 
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9. Find the length of the arc of the parabola given 
y the equation y # 2 , lying between the points with 
tie abscissae and a. 

10. Given an ellipse with the excentricity e and with 
tie large axis of length 2, express its perimeter by means 
f a power series with respect to e. 

11. The circle given by the equation (xa) 2 + y* r* 
ring on the JTY-plane rotates (in the space) around the 
^-axis. Evaluate the area of the surface of the solid 
btained in this way, called the anchor ring (we assume 

>r). 

12. Evaluate the area of the common part of the 
Lrcle with the radius r and an ellipse with the axes a 
rid b having the same centre as the circle. 

13. Applying the Simpson formula to the integral 
* fl x 

2 , evaluate the 5 first figures of the decimal ex- 

J. ~i oo 

ansion of the number JTT. 

14. Show that the Simpson formula (24) gives the 

rea with an error less than j^. - , where M denotes 

he upper bound of |/"'(#)| in the interval a < x < b. 
To prove this, introduce an auxiliary function: 

c+t 

g(t) = J/^)^-|[/(o-) + 4/(c) + /(o + t)] ? 

c-t 

, 
where c = 



nd deduce the inequality -~2M <g'"(t) <2Jf. Get 

o o 

lie required result, integrating this inequality. 
15. Prove the Schwarz inequality for integrals: 

6 6 b 



* f 
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b 

(Apply the inequality / [/(a?) +c- g(x)fdx > which 

a 

holds for every c). 

16. Give the formula for the radius of curvature at 
the point #, y for the following curves: 

.2 |*2 

1) hyperbola xy = 1, 2) ellipse ~i + |i = ^ 

3) parabola y = 4p# 2 , 4) hypocycloid x% + y% = a*, 
5) the curve y = x*. 

17. Find on the exponential curve y = 0* the point at 
which the curvature is a maximum. 

18. Given the hypocycloid from the exercise 16, 4). 
Evaluate its length, the area of the region contained 
inside of it, the volume and the area of the solid of 
revolution obtained by the rotation of this hypocycloid 
around the X-axis. 

19. A system of functions / l? ...,/n, is called linearly 
independent, if no system of n constants c lj ...,c n exists 

except of the system of n zeios) such ttat the equality 



holds for every value of x. 

Prove that a necessary and sufficient condition for 
the linear independence of a system of n continuous 
functions in an interval ab is that the inequality 

a u . . . a 



b 

holds, where a km = / ik(^)f m (x)dx. 

a 

(Apply the conditions for the existence of non-trivial 
solutions of a system of n equations 



with n unknowns). 
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20. A finite or infinite system of functions /i ? / 2J ... 
is called orthogonal in the interval ab, if the conditions 

= for fc ^ m , 

^ for k = m 

are satisfied. 

Give examples of orthogonal systems among the tri- 
gonometric functions. 

21. Prove that the polynomials (so called Legendre ( l ) 
polynomials) defined by the formula 



n( ' 



2 n nl 



constitute and orthogonal system in the interval 1, +1. 

+1 
(First prove that if m < n, then / w n (x}*x m dx = 0.) 



11. IMPROPER INTEGRALS AND THEIR 
CONNECTION WITH INFINITE SERIES 

11.1. Integrals with an unbounded interval of integration 

Let a continuous function y = f(x) be given in an 

X 

infinite interval x > a. Then the integral / f(z}dz exists 

a 

for every x > a. If there exists 

X 

lim F (x) , where F(x) = f f (z) dz , 

*- a 

oo 

then this limit is denoted by the symbol J f(x)dx and 

a 

called the improper integral (of the first kind) of the 
function f from a to oo. Assuming the existence of this 



Adrien Legendre (1752-1833), a great French mathematician. 
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limit, we have then 
(1) 

a *-o 

We say in this case also that the improper integral is 
convergent. 

X 00 

If lim ff(z)dz^= oo (or -co), then we write / f(x)dx 

scoo a a 

= oo (or oo); in this case we say that the integral is 
divergent to +00 or oo. 
Similarly, we define: 



a a 



(2) /(a?)flte== lim 



X--00 



X 



and J j(x)dx J f(x)dx+ J f(x)dx. 

oo oo 

We have by the definition: 

)-F(a)'} - ]\mF(x)-F(a) , 



where F is a primitive function of the function /. 
E.g. 



dx I" 11 r 1 
~^- = = hm - 

J & [ X\l x-co 



Hence this integral is convergent. More generally, for 
s > 1 the integral 



is convergent. 

But for s = l we obtain an integral divergent to oo: 

00 
I t \ 

(4) 
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An example of an integral having neither a finite nor 

oo 

an infinite limit is / sin x dx, since lim cos# does not exist. 

= 00 

In the last example the essential fact is that the 
function under the sign of the integral assumes positive 
as well as negative values. In fact, the following theorem 
holds: 

00 

3. // f(x) > for x > a, then the integral J f(x)dx has 

a 

either a finite or an infinite value (according to whether 

X 

the function F(x) = / f(z)dz is bounded or unbounded 

a 

in the region x^a). 

Indeed, the function F(x) being non-decreasing, it 
possesses the limit lim F(x) finite or infinite according 

to whether this function is bounded or unbounded (cf. 
4.7, 1). 

Theorem 4' of 4.7 implies the following theorem, 
immediately : 

2. A necessary and sufficient condition for the convergence 

oo 

of the integral / f(x)dx (to a finite limit) is, that to any 

a 

s > a number r exists such that the conditions x> r and 
x' > r imply the inequality 

_')dz < e . 

x' 

Indeed, the existence of the limit lim F(x) is equivalent 

x=oo 

to the condition that to every e > there exists a number r 
such that \F(x)~ F(x')\ < e, whenever x> r and x' > r. 
Since 



< 



z, so 

X f 
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oo 

Geometrically we interprete the integral / f(x)dx simi- 

a 

larly as the integral in finite limits: if /(a?) > 0, then this 
integral means the area of the unbounded region made 
up of by points #, y such that x > a and < y < f(x). 

11.2. Integrals of functions not defined at one point 

Let a continuous function / be given in an interval 
a < x < b (the interval without the point b). Thus for 
any x satisfying the above condition the definite integral 

X 

f f(z)dz exists. If there exists the limit lim F(x), where 



re=6 



J?(x) = J f(z)dz, then this limit is denoted by the symbol 

a 
b 

/ f(x)dx, as in the case considered in the previous section, 

a 

namely, as in the case when the function / is defined 
and continuous in the whole interval a < x < b (together 
with the ends). In the last case the definition given in 
10 (formula (1)) is consistent with the definition of the 

b 

symbol ff(x)dx given at present. In other words, if 

a 

a function f(x) is continuous in the interval a < x < 6, 

b 

then the integral / f(x)dx (in the sense of the definition 

a 

in 10, formula (1)) satisfies the condition 

b x 

(5) Jf(x)dx=z Mm F(x), where F(x) .= j f(z)dz. 



This equation means that F(b) = lim F(x), i.e. that 

a?=6-0 

the function F(x) is (left-side) continuous at the point &; 

but this follows from Theorem 10 of 10 (Eemark (p)). 

The integral of a function / defined in an interval 

a < x < b is called an improper integral (of the second 
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kind). If this integral exists, i.e. if lim F(x) exists, then 

x=*b-0 

we say that the integral is convergent. 

If the function / is defined and continuous in an 

b 

interval a < x < 6, then the integral ff(x)dx is defined 

a 

analogously: 

? 6 

ff(x)dx = lim ff(z)dz. 

a x-a+0 x 

More generally, if a function / is defined and con- 
tinuous in an open interval a < x < b and if the improper 

c b 

integrals J f(x)dx and J f(x)dx are convergent, c being 

a c 

an arbitrary point of the interval a < x < b f then by 

6 

the integral J f(x)dx we understand 



a 

b c 





(6) / /()*= //( 



It is easily seen that this sum does not depend on 
the choice of the point c. 

Yet more generally, if the function / is defined and 
continuous in an interval a < x < b except of a finite 
number of points (in which the function is not defined 
or is discontinuous), then by the (improper) integral of 
the function / in this interval we understand the sum 

b cii az On 

(7) fj(x)dx= f f(x)dx + f f(x)dx + ...+ //(a?) Ac, 

a a i a n-\ 

where a = a < a x < a 2 < ... < a n = 6, and all points such 
that / is undefined or discontinuous at these points are 
contained in the system of the points a , 1? 2 ? > a n- 

b 

So the integral J f(x)dx is convergent, if all integrals 

a 

on the right side of foimula (7) are convergent. 
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1. If a junction f(x) is bounded and if it is defined and 
continuous except of a finite number of points of the interval 

b 

ab, then the integral ff(x)dx is convergent. 

a 

According to the formulae (6) and (7) it is sufficient 
to prove this theorem in the special case when the func- 
tion / is defined and continuous for a < x < b. 

For this purpose let us note that there exists a necessary 
and sufficient condition of the convergence of improper 
integrals of the second kind analogous to the condition 
given for improper integrals of the first kind ( 11.1, 2): 

2. A necessary and sufficient condition for the con- 

b 

mergence of the integral / f(x}dx of a function defined and 

a 

continuous in a < x < b is, that to any s > a number 
6 > exists such that the conditions < b x < 6 and 
< b x r < d imply the inequality 



(8) ff(z)ti 



< 8 . 



Indeed, writing F(x) = / f(z)dz we conclude from 

a 

Theorem 4 of 4.7 that the existence of the limit lim F(x) 

x=*b-0 

is equivalent to the inequality \F(x) F(x')\ < s (when x 
and x' satisfy the above mentioned conditions). But 

F(a?)-W)= 

x' 

whence the formula (8) follows. 

Let us now proceed to the proof of Theorem 1. Given 
an e > 0, a number 6 > has to be chosen so that the 
conditions < b x < d and < b x f < d imply the in- 
equality (8). 

The function f(x) is by assumption bounded in 
a < x < b. Thus, a number M exists such that M > \f(x)\ 
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for every x in the considered interval. Let us write 6 == e/M. 
Now, 

X 

\ji(z)dz\<\x-x'\M 

x' 

and the inequalities < b x < d and < b x' < d imply 
|##'| < d ~ e/M, whence the required formula (8) follows. 
In this way Theorem 1 is proved. Thus, the notion 
of an improper integral makes possible a generalization 
of the notion of the definite integral to bounded functions 
having a finite number of points of discontinuity. 

EXAMPLES, (a) / = - - [X I ~ S ]Q = - -- for s < 1. 

O 0(j JL S -L $ 

}dx 

- = oo. 

6 ft 

i ^ 

(p) J sin-dte exists by Theorem 1, since the function 

o ft 
under the sign of the integral is continuous and bounded 

for < x < 1. 

(y) Similarly, the integral / -dx exists. In this case 

o & 
the integral is considered to be seemingly improper; 

although the function under the sign of the integral is 
riot defined at the point 0, it possesses a limit at this 
point. Assuming this limit to be the value of the integrated 
function at the point we obtain a definite integral 
(of a continuous function) in the usual sense. 

(S) Analysing the definition of the (improper) integral 
of a function / defined and continuous in an open 
interval a < x < b we see that this integral may be 
defined as the difference F(b)F(a), where F(x) is an 
arbitrary function continuous in the closed interval a < x 
^ b and satisfying the condition F'(x) = f(x) in the open 
interval a < x < b (of course, if such a function F exists). 

T tv* fj w 

E. g. the integral f , which expresses the length 

2 2 



of a semicircle with a radius r is an improper integral 
(the denominator of the integrated function vanishes at 
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the ends of the interval of integration). However, since 
the primitive function of the integrated function, i.e. F(x) 
= rare cos (x/r) is continuous in the whole interval 
r<#-<r, the value of the considered integral is 
expressed by the difference F(r) F(r) = nr (just as in 
the example considered in 10.5). 

Bemark. An improper integral of a function bounded 
and continuous except of a finite number of points is equal 
to the Eiemann integral of this function. According to the 
theorem on the division of the interval of integration, 
the proof is reduced to the case when / is continuous in 
the interval a < x < b. Moreover, according to the con- 
tinuity of the Riemann integral treated as a function of 
the upper limit of integration (cf. 10.11) and to the 
integrability of the function / in the sense of Kiemann, 
the Eiemann integral of the function / in the interval ab 

x b x 

is equal to lim ff(x)dx, i.e. = ff(x)dx (the symbols / 

x**bQ a a a 

b 

and J are applied here in the sense of the definition 
of 10.1 and 11.2). 

11.3. Calculation formulae 

Let the functions f(x) and g(x) be continuous and 
defined for a < x < 6, where b may also denote oo. Let 
us assume that the integrals (improper of the first or of 

b b 

the second kind) J f(x)dx and / g(x)dx are convergent. 

a a 

Then the formulae 1 and 2 of 10.2 remain valid, for 

b x 

f[f(x)g(x)]dx=\imf[f(x)g(x)-]dx 



a 
x 



= lim J f(x)dxlim J g(x)dx 

x=b a x~b a 

b b 

= j f\x)dxJ g(x)dx. 
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It is proved similarly that the formula 2 of 10.2 
holds. 

The formula for the integration by parts (i.e. the 
formula 3) remains also true assuming that f(b)g(b) de- 
notes limf(x)g(x). 

x=b 

Similarly, denoting lim/(#) by j(b) (where b as well 

x~b 

as f(b) may be also oo) the formula 4 for integration 
by substitution holds. Namely, assuming the integral 

/(/>) 

J g(y}dy ^ b e convergent, we have 

/(a) 



/(*) v m 

-lim / g(y)dy = lim / g(y)dy = j g(y)dy , 

/(a) 



since the integral treated as a function of the upper limit 
of integration is continuous ( 10.2, 10). 

Assuming the strict monotony of the function /, the 

6 

convergence of the integral f g[f(W()dx implies the 

a 
/(&) 

convergence of the integral J g(y)dy. Hence the pre- 

1(0) 

viously proved relation may be reversed; namely, ac- 
cording to the equation lim h(y) = 6, where h(y) denotes 

y=J(b) 

the function inverse to /(#), the previous argument may 
be performed also in the reverse direction. 

Other calculation formulae: the formula 5 on the 
division of the interval of integration and the formulae 
6-8 may be also generalized easily to the case of improper 
integrals. 

Eemark. Let a function / be piecewise continuous in 
an interval ab. This means (cf. 5.1) that there exists 
a system of points a Q < a^ < a 2 < ... < a n , where = a 
and a n = fe, such that the function /* defined by the con- 
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ditions f k (x) = j(x) for a*_i < x < a k , 

and f k (a k ) = /(a* 0) is continuous in the whole interval 

A:-l<^^% (& = 1,2, ...,tt). 

Then we have 



a k n a k 



a k**l a k _i fc=l o fc _ 1 

Using this equation and taking into account the fact 
that J f k (x)dx is a proper integral we state easily that 

the formula for the integral of a sum remains valid if 
the functions / and g are piecewise continuous and that 
the formula for the integration by substitution remains 
also true assuming the functions g [/(#)] and f(x) to be 
piecewise continuous. 

11.4. Examples 

(a) To evaluate the integral f ^ , we substitute 

b (I + x ) 
x = tank Since tanO = and lim tantf = oo, we have 

00 7T/2 Tt/2 

1 f "\ \ rf> \ F /Jf 1 

/ I J. ~| JU I / it/v / 

00 

-J - for n > 1 



The same integral may be evaluated applying the 
recurrence formula ( 9.3, 5, 



r dx ___ 1 x 2n 3 r dx 

and taking into account that 

= and 
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/* mn 'T* 
(P) To prove the convergence of the integral / * - dx 

*^ 

we shall apply the second mean- value theorem ( 10.7) 
taking into account the fact that the function - is de- 
creasing. We obtain 

6 



oc 



/' sin# 1 f . , 1 f . 

-- dx=~ smxdx + T s 
J x a J bJ 



. 7 
smxdx . 



Let an > be given. An r has to be defined so that 
the conditions b > a > r imply (cf. 11.1, 2): 

b 

sin a? 



dx 



< e. 



Now, 



smxdx 



t'smxj _/l 1\ 4 4 

dx ^2 - + r)<-<-. 

J x \a o/ a r 



Thus, it suffices to assume r = - . 
We note that 

a co 

,. C m\nx , f sino? , . ~. 
(9) lim dx ^ --- dx (a>0). 

OT,=aOO J X J X 



o o 

Namely, let us substitute y = n^. We obtain 

na 

11 r if 

<% 



(10) 
and 



f sin no? ,, / 

- do? = 
J x J 



y 



because lim na oo. 

noo 



Eemark. Let us write I n = / 



sin?/ 

- 



sin a? 



x 



dx. Then we have 



00 sin* 



J dx = I n . This is an alternating series (which is 

& n-0 
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also easily to illustrate geometrically on the graph of 

mn IT 

the function y = , cf . Fig. 25) with (absolutely) 

x 

decreasing terms tending to 0. Indeed, substituting 
y = xnn we have 






J 



y 
o 



J 



and 



C sin?/ r 

dv < 
J y + rnc J J 



sin y 
7 ~^r~ 
(nI)n 



dy =-- T I n -i - 




3jt 



PIG. 25 

Hence it follows easily that for every a > 0, we have 
the formula 



(11) 



/sin# _ C sin x , 
dx ^ dx . 
J[/ \ *J X 



This formula together with formula (10) gives 



(12) 



x 



dx 



( smx -j 

dx . 

J x 



(y) Similarly as in the previous example, we prove 

00 

the convergence of the integral Jsin(# 2 )d# (the Fresnel 



integral applied in optics) although we do not know the 
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indefinite integral. Substituting x* t we obtain 

CO CO 

r sin ,. 



Applying the second mean-value theorem to the last 
integral we find that 

6 b 

fsinJ, 4 1 C . .,. , 1 C . .-. 
dK = -^i sin<& + tr sin t <U 

i i' \ a i \ b i 

co cvnf 

and we prove the convergence of the integral f "=-dt 

i yt 

by the same arguments as in the previous example. Thus, 

OO 

the integral J sin(x*)dx is convergent, too, and so does 
i 

CO 1 

the integral j sin(# 2 )<fe, since the integral f sm(x 2 )dx is 

6 b 

a proper one. 

(S) We have proved previously the convergence of the 

CO 

integral / - dx. Now, we shall j)rove that 



(13) 

i* 
o 



CO 

' sin o? , TU 
t=- 



According to (9), 

TC/2 

/' sin a? 
-- 

.' X 




T f sin^wc , 
= lim - dx , 

n=0 o .' X 



whence 

TT/2 



f sin,T f sin(2H 

-- dte = hm - 

/ T n=co X 





We shall reduce the last integral to the integral 
sin ( 
o 



sn ^^^ ,., ! , IVT i 

j ^__ -- '~dx, which we evaluate now. Namely, we 

? J7 
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shall show that 

71/2 

^ ^ C sin(2n+l)#-, TU 

( 14 ) tfz dx = o 

J Dill JU A 



Indeed, it follows from the formula (cf. 1, (2)) 



- 
that 



sm# 
whence 

Tt/2 

ain TQ-M. -J_1 ^ ^ 

-dx = 



Tt/2 7T/2 

TU r r TC 

~ 2 J J ~~ 2 ' 



since all integrals appearing in expression in the middle 
part of this formula vanish. 

Hence the formula (14) is proved. It remains to prove 
that 

7T/2 

lim 

n=*oo ^ 

i. e. that 

7T/2 



_ sin(2n+l)*K = Q 

^ J 



lim I -. sin(2n +I)xdx = . 
n oo ^ o?sina? 
o 

Now, the last equation is a direct consequence of the 
formula 

71/2 

lim J / (x) sin nx dx = 
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which we have proved already ( 10.2, (y)), after the 
substitution 

/y _ Q T *- /v 

/(a>) = ___^L* for x > and /(O) = . 
1 ^ ' xmix 

The function / defined in this way is continuous, since 

- (cf. 8.4, (18)). 
^ * ? " 



i x T^ ui 4. 4. i 
(s) Dirichlet integral: J 



o 
We shall prove that if the function f is monotone and 

if f is continuous in the interval < x < a (a > 0), 



. . ^. .. / ,, x sri^^ _ re , 

(lo) hm /(a?) --- rte = - /(O) . 

n=^-<x> J Jv 



Let a number e > be given. We choose c in such 
a way that 

(16) I/(0)-/(0)|< and 0<c<a. 



/* SI Tl 'W 'I* 

In order to estimate the difference J /(a?) - dx 

o *^ 

~/(0), let us write 



C ,, ,sin^o?, TC,,^ f 
J /(a?) <to-2/(0) = J 



c 

TU\ 
-2 



, sin nx , 
a?) ~^^ 

C 

and let us estimate each of the three terms on the right 
side separately. 

To the first term we may apply the second mean- 
value theorem, since the function g(x) = /(#) /(O) is 
monotone. Taking into account that #(0) = we obtain 

c c 

sinno? , 



f 
J 
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By (12), 
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sin o? , 

- ax . 
x 



I tjiiLiviJU -. l SI 

dx <2 - 

j x J > 



This inequality together with the inequality (16) gives 



(17) 



U 

f 

./ 



To estimate the second term let us note that by (9) 
and (13), 

c 

aiti /M/, /t 

dx = - . 



V f S * 

lim 

noo ^ 



x 



Hence we have 



(18) 



f siiii 
J a? 



dx- 



2 



< e 



for sufficiently large w. 

Finally, replacing f(x) in the formula 10.2, (y) by 

^ and taking into account the inequality < c < a, 



o? 
we obtain 



sn wo? 



v f ^A x sin 
lim /(a?) 

n=c / ^/ 



whence we conclude that 



(19) 



smtM? 

' x 



dx 



< 



holds for sufficiently large n. 

The estimations (17)-(19) give the required estima- 
tion for 



i* 
f 

J 



sn no? , TT 



, 

~~ i( 0) 



whence we obtain formula (15). 
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Remark. The formula (15) remains valid, if we re- 
place the assumption of continuity of /' and that of 
monotony of / by a weaker assumption, namely, by the 
assumption that the function / is piecewise continuous 
together with its derivative and piecewise monotone ; here 
/(O) has to be replaced by /(+0) (in the case when the 
function / is discontinuous at the point 0), i.e. 



(20) 

Indeed, our assumption means (cf. 5.1) that there 
exists a system of points = a < a l < a 2 < ... < a m = a 
such that the function /& defined by the conditions 

f k (x) = f(x) for ajc-i < x < a k 

and /fc(a*-i) = /(fc-i + 0) , f k (a k ) - f(a k 0) 
is continuous together with its derivative and monotone 
in the whole interval a^-i <S x ^ <*>k ? for each k ^ m. 

Applying the theorem on the division of the interval 
to the improper integrals we obtain 

a i a m 

* sinnx _ C . . . minx ' 



. 

ao m-l 

Hence 

a m a )k 

.. f .. . smnx , \^ T f / / v siiin.7; .. 

Inn j(x) -- dx -- > Inn h(x) --- dx . 

n=oo J $> * ^ n oo / ^ 

*=-! a^.^ 

But this gives the formula (20), since by (15) we have 

ai 

v f^/ v sinn# , 7c^ /A v ^// , A \ 
Inn /i(0) &0 = o/i() = 9/(+ ) 

n=oo */ */ ^ ^ 

a 

and, on the other hand, we have by 10.2, (y), 



v f , 7 , sinnic 

lim /A; (x) ax = 

n = oo *^ ^ 



19 
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for each k > 1, the function -^ - being continuous in 

iJL' 

the interval %-i <#<#&. 

() The following formula which will be used in the 
theory of Fourier series follows easily from the formula (15): 



(21) lim /(aO<fo = /(+0), 0<a<7r; 

' V ' ' ' 



here we assume as previously the function / to be piecewise 
continuous (together with its derivative) and piecewise 
monotone. 

For this purpose it is enough to note that if we have 
^ n < v < 7t, then 



I'.// xSinwff 7 /' .sinwo? \ 

f(ac)rdx /(#) - <fe 

J ; ; sm a? ./ a? { 

1* w 

v 

i- T ^/ v# sin# . 
= lim /(#)- : -- s 
n-oo J a? sin a? 



A 

= . 



/v sin 'y 
For, taking into account the equation lim - : - ' 



(cf. 8.4, (18)) and the inequality x < TT, we may substi- 
tute to the function /(a?) in the formula 10.2, (y), the 

,. ,, . a? sina? 
function f(x) 



oo 



Poisson (*) integral f e~ x2 dx = ?- . 



o 



First of all let us note that applying the substitution 
x = ^|/n, we obtain 



foo\ I /> z 2 /7/r 1//W I /> ft* 2 /?* 

\LiJ) I (/ ttol/ ~ I/ I v I t/ tw<v 





( l ) Simeon Poisson, an author of numerous works in the cal- 
culus of probability, in mechanics, physics and astronomy. 
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In order to be able to compare the last integral with 
the integrals 



(23) 

a 



and 



* 2-4.....(2n-2)2 



which we already know (cf. 10.2, (5) and Example (a)), 
we apply the double inequality 



which follows from the inequality e t ^ 1 + t (cf. 8.4, (16)) 
by substitution t x 2 and t = a? 2 . Then we have 



(the first inequality being valid for \x\ < 1), whence 

1 1 OO CX) 

I (l-.^) /l ^ v I e~*fa< | u-'^Au-r: f ~ --. 
' ' ' ' " ^ (14- # 2 ) 

^ ^ ' 

Taking into account the formulae (22) and (23) we 
conclude that 



2-4-...-2-U r 2 ^ 

M a'- ^r 2^TT) - J ^^ 



3- 4... . (a 2) 2 ' 
Denoting by a n the left-side term of this relation 

00 

and by b n the right-side one, we have a n < j e~ x *dx^b n 

o 
for each n = 1, 2, ... 

Now, we have by the Wallis formula ( 10.9, (25)): 

. 1 2-4-...-2M 

where ^ n = -- ---------- 

2 1 n 1-3-.. .-(2^-1) 
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Hence a n c n '^-- and, since the sequence {c n } is 
decreasing as easily seen, - 4> -<^n? i- . ~<2(?n5 hence 



W ""^ r (\ A I C\nn O \ ^ ** O/M 1 

Consequently, we conclude that 

2n , T ^, . 2' 

Cn '2w+l 

o 



I /> x% /7/-/ *""" /* . 

J 6 (U ^ Cn 2n-l 
and since 



r 2n 2n 
lim 7r~ L = 1 = lim -~ 



we have 



I e- a!a * = limc n - ~- . 

^ n=oo ^ 



11.5. The Gamma function F(x) = /F^e-'di, a? > 



This integral possesses for a? < 1 both singularities: 
namely, it is an integral in an infinite interval of in- 
tegration and moreover, the integrated function tends 
to oo as t tends to 0. In order to prove its convergence 
we shall decompose it into two integrals: 

1 00 

(24) J t x ~ l e- t dt and j t x ~ l e~- i dt 

o i 

and we shall prove the convergence of each of these 
integrals separately. 

To prove the convergence of the first of these integrals 

let us note that < i x ^e" 1 < t x ~ l , since t > 0. But the inte- 

i 
gral J t x ~ l dt is convergent, since 1 #< 1 (cf. 11.2, (a)); 



11. IMPROPER INTEGRALS 293 

hence we deduce the convergence of the first of the 
integrals (24). 

Now, 



Hm~- - (cf. 7 (27)), 

6 - J=--3 

whence we have t*- 1 e~ l < - for sufficiently large tf, and the 

t 



convergence of the second of the integrals (24) follows 

OO -t 

from the convergence of the integral / -^ (cf. (3)). 



In this way the convergence of the integral F(x) is 
proved for every x > 0. 

Now, we shall prove for positive integers n the formula 

(15) r(n)-(n-l)I 

For this purpose we apply the formula for integration 
by parts to the integral V(x) for x> 1: 



(26) r<) = -|H-'^-* 



Hence we deduce tho formula (25) by induction, ap- 
plying the equality 

no 

/'(I) =- jV'd* - 1 -0! 
n 

Let us note that the Poisson integral considered in 
11.4 is one half of the value of the F function for x = J, 
since substituting t = z* we find 



(27) 
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11.6. The relation between the convergence of an integral 
and the convergence of an infinite series 

THE CAUCHY-MACLAURIN THEOREM. Let the function 
/(#), x > a, be continuous, decreasing and positive. Then 
a necessary and sufficient condition for the convergence of 

oo 

the integral I f(x)dx is the convergence of the infinite series 

a 

I /(+). 




a a+1 



FIG. 2(> 



By the assumption, f(a + n) . /(.r) C f(a + n 1) for 
a f n1 < x < a + n. Hence 

afn a+n a +11 

I f(a + n) dx ^ f / (x) dx \ / (a -\- n - 1 ) dx , 



a f ;j-l 



a-f n 1 



i.e. 



Denoting by 8 n the partial sum of the series J^ f(a + m), 

m-l 

i.e. $ n /(+!) + ... +/(a + n), we have 

o-J-n 

:_!+ /(a). 



11. IMPROPER INTEGRALS 295 

Assuming the integral to be convergent, we conclude 

00 

that the considered series is bounded: 8 n < //(#) dx, and 

a 

so it is convergent (as a series with positive terms). Con- 
versely, assuming the convergence of the series, we have 

a+n oo 

J^r-^ 
f(x)dx < > /(a + m) for each n. 
' ' Jm^J 

Hence 

.r oo 

J f(x)dx -v ^ f(a 4 m) for every .r, 

a m-O 

since, denoting for a given x by n a positive integer 
such that x < a + n, we have 

x a+n oo 

/r \ ^ 

f(x)dx -:' J f(x)dx <^ 2^ ffa + m) . 

n n 7M=0 

80 the function J f(x)dx is bounded and, consequently 

a 

oo 

the integral f f(x)dx is convergent (cf. 11.1, 1). 

a 

Remarks, (a) The assumption that the function / 
is positive may be omitted in the above theorem. Namely, 
if a decreasing function is negative, then the integral as 
well as the considered series are divergent to oo. 

oo 

(p) If the integral //(a?) dx of a decreasing function 

a 

is convergent, then lim /(a?) = 0, as is easily seen. However, 

x-oo 

if the function is not decreasing, then the integral may 
be convergent although this inequality does not hold. 

00 

The evidence gives here the integral f m\(x 2 )dx which 

6 
we have considered already in 11.4, (y); this integral 

is convergent but the limit of sin (a? 2 ) as x tends to oo 
does not exist. 
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Assuming f(x) > 0, an even stronger singularity may 
be obtained. Namely, let us construct an infinite sequence 
of isosceles triangles with height 1 and having the inter- 

vals (0, 1), (,1 1J), ..., U, + on> of the ^' axis as 



bases, successively. Let y = /(a?) be the graph of an 
infinite polygonal line constituted by the sides of these 




1 2 

FIG. 27 



triangles (different from the bases) and the segments of 
the X-axis joining the successive triangles. Thus, the 
region contained between this polygonal line and the 
X-axis is constituted by the above triangles; hence its 
area is the sum of their areas, i.e. 



However, lim/(#) does not exist. 

X = OO 

00 j 

EXAMPLES, (a) The series (s) = J~ is convergent 

* 



for every * > 1 ( x ), since the integral / is convergent 
(cf. 11.1, (3)). 

00 1 

(S) The series X 7; ~ 8 is convergent for s> 1 and 

nlz n(logn) 

divergent for ,9 = 1. 

(*) The (Riemann) function {() is of great importance in the 
theory of numbers. 
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00 doc 

To prove this, let us consider the integral } r^- 

^ ' 2 a? (log a?) 

Now, 



JdX / \A> A*-' 3 K/ -A -I. jf 

/vt 1 1 f\ ff /v> \ i /lfiO > 'O ri i 1 <? i loo* 7 /?! 

JU \ \\JcL JU i / I ^"o **/ I -l~ o V^-^ o */y 

Since 

lim (logo?) 8 " 1 = oo , 

we have 



Hence we conclude by the Cauchy-Maclaurin theorem 
that our series is convergent for s > 1. Yet for s = 1 this 
series is divergent, for 



f dx C 
J l^x = J 



According to the equation lim log(log^) oo, this implies 

a;=c 

> 

the divergence of the integral / 

to to 



2 
(y) Similarly, it may be proved that the integral 

dx 



is convergent f or s > 1 and divergent for s = 1 (where a 
is sufficiently large). Hence the series 

00 

V 

*J ' 

n~k 

is convergent for s > 1 and divergent for * = 1. 

More general results may be obtained considering the 
product of n successive iterations of the logarithm the 
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last of which is raised to the power s (in the previous 
example n = 2, the zero -iteration = x). 

This leads to further types of convergent series and 
to an infinite sequence of infinite series 

oo oo oo 

YII v i v i 

^ \ > . . PTC 

j^j n' <Lj ^log^ 7 ^- J nlogr^log(logn) 

divergent more and more slowly. 

(S) Logarithmic criteria. The comparison of the 

oo 

terms of a given series a n with the terms of the series 

oo ~[ 

~~~ 8 leads to the following convergence criterion: 



*/ a n > 

(28) 



then the aeries a n iv convergent] if thin limit fv >l, 

n=2 

^Aaw <Ae series is divergent. 

Indeed, let us assume the inequality (28) to be satis- 
fied and let us denote by ~s a number greater than 
the considered limit and less than 1. Then we have 
8 > 1 and 

log('/m n ) < -#log(log-M) - log (log -w-)"" 8 
for sufficiently large w-, whence 

na n < (logw)~% i.e. a n < - -- . 

n(]ogn) s 

Thus, by the theorem on the comparison of series 
with positive terms, the convergence of the series 



implies the convergence of the series 
l & 



n t^ n(logn) 

Yet if the limit considered in the formula (28) is 
greater than 1, then for sufficiently large n we have 
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log(na n ) > log(logw), whence na n > (logw)"" 1 , i.e. a n > 

> r ~~ and the divergence of the series 5] = 

niogn n 2 nlogn 

oo 

implies the divergence of the series JT a n . 

The case when the considered limit is equal to 1 
is for our logarithmic criterion a "doubtful" case, i.e. we 
are not able to state by this criterion whether the series 
is convergent or divergent. However, in this case stronger 
logarithmic criteria of the considered in Example (y), 
may be applied. 

Let us add that there exist series (with positive terms) 
which do not react to any logarithmic criterion. 

11.7. Fourier (*) series 

Suppose that we are given a convergent trigonometric 
series of the form 

(29) /(0) = K + (< 



We note that if the given series is uniformly convergent 
in the interval n < x < TT, then the coefficients a n and b n 
may be expressed easily by means of the sum of the series, 
i.e. of the function /. For, according to the uniform con- 
vergence we have (cf. 10.2, 12) 

7T 71 00 7T 

> 



^-J . 

n=l n 



/ / 

J J 2 

7T 7t 

and since 

I cosnxdx = 0=1 sinnxdx and I ~dx = na 



7t K 



( 1 ) Jean Fourier (1768-1830). Fourier introduced the expansions 
of functions known under his name in connection with his work in 
the theory of the heat conduction. 
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we have 

TT 



(30) 



TC . 



To evaluate a nj we multiply both sides of the identity 
(29) by cosnx and we find 

TC TC 

I f(x)eo&nxdx J ~cosnxdx-i 

n 

OO TC 

a- v r 



re 
oo TC 



( a m cos mx cos nx + b m sin mx cos nx) dx , 

m 1 TC 

just as in the previous calculation. 
Since (cf. 10.1, (S)) 

TC 

J cos 2 no?d# = TC 

TC 

TC 7T 

and I QQ&mxGiQ&nxdx = = 

TC TC 

for m 7^ n, we have 

(31) a n = - ( f(x)eosnxdx. 
Similarly we find 

(32) b n = - j f(x)&i&nxdx. 



71 



The following question arises: which functions / 
may be represented in the form (29), the coefficients a n 
and b n satisfying the formulae (30)-(32) (the so-called 
Euler-Fourier formulae). If such an expansion exists, then 
it is called the Fourier series of the function f. 

Since the functions cos and sin are periodic, it is 
evident that the periodicity of the function / has to be 
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assumed, too. Moreover, we shall assume that the func- 
tion / is piecewise monotone (cf. 4, 2). 
We shall prove the following 

THEOREM. Every periodic junction f with the period 2n 
(i.e. f(x + 2n) = f(x)), piecewise continuous (together with 
its derivative )j piecewise monotone and satisfying (at the 
points of discontinuity) the condition 

(33) 



may be expanded in a Fourier series. 

Let us denote by S n (x) the ti-th partial sum of the 
series (29), i.e. 

(34) S n (x) = |a + (a 1 coso? + ftiSina?) + ...+ 

+ (a n cosnx + b n smnx) . 

We have to prove that if the coefficients satisfy the 
conditions (30)-(32), then 

(35) f(x) = lim flf n (o?) . 

noo 

The above mentioned conditions make it possible for 
us to transform formula (34) as follows: 

7t 7t 

(36) itS n (x) - 



TC 

...+ I 



n 

= \ 



t x 



o - 
2 8 m- 
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by the known formula (ct. 1, (2)): 

,. 2n +1 
... + Go&nt = 7 





Let us substitute -~~ = 2;. We obtain 



(37) 



2 

Decomposing this integral into two integrals in the 
intervals from to - and from - to and 
substituting in the second integral z = y, we obtain 

(38) nS n (x) - 

o 

n+x 



. / ^/ o \ sm^n + l)y - 

1(x2y) ^-: --- Ay. 
J ;v J/ sm 



Now, we shall prove the equation (35) for TT < x < TT. 
According to (33) it is sufficient to prove that 



(39) lim 

noo 

and 



2 
(40) lim J 1(x- 



Sin?/ 



Given o? ? let us write /(#+ 20) = gf(^). Then the function 
g(z) is piecewise continuous (together with its derivative) 
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and piece-wise monotone, Hence it satisfies (cf. (21)) the 
formula 



lim tf()fe=</( + 0), if 



TL 'T 1 

In this formula a may be replaced by , because 

A 

TT - /y 

the inequality TT < # < TU implies the inequality < 

J 

< TU. Since flf( + 0) = /(#+0), formula (41) gives (39) 
immediately (we restrict ourselves from the sequence 
n = 1, 2, ... to the subsequence of the odd numbers). 

Formula (40) is obtained in an exactly similar way, 
writing f(x2y) = h(y) and taking into account that 



Thus, om^ theorem is proved for TT < x < -K. It re- 
mains to consider the case when x -= n' (or when x = TT). 
Let #~ TT. According to (37) we have 



i 4i 

= /( 

J ; 



Decomposing this integral into two integrals in the 
intervals from to ivr and from |TC to n and substituting 
y ^n z in the second integral we obtain 



'/ (Tt - 

./ x 



The first of these integrals tends to |TT/( 7r + 0) as 
previously and the second one tends to ^/(TT 0), i.e. to 
|7r/( TT 0) (since the function / is periodic). 

Hence the formula (35) holds also for x = TT; hence, 
according to the periodicity, it holds for every x. 

In this way our theorem is proved completely. 
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11.8. Applications and examples 

(a) Let f(x) denote a periodic function with the period 
2ru given by the following conditions: 

j(x) - - ITT for -7c < x < 0, /(O) - , 
= }?: for <x< TT, /( :r) =0. 



The graph of this function consists of segments of 
the length TT lying on the straight lines y = |TI and 
t/ = JTT, alternately, and of points on the ^Y-axis being 
integer multiples of the number TC (the ends of the segments 
do not belong to the graph). 



-2Ji -Ji Jt 2JC 

FIG. 28 

It is immediately seen that the function defined in 
this way is piecewise continuous and piecewise monotone 
(namely, it is monotone in intervals of the form (m l)rc < 
< x < WTC, where m is an integer); moreover, the con- 
dition (33) is satisfied. The theorem on the expansion 
in Fourier series may therefore be applied to this function. 

We calculate the coefficients a n and b n according to 
formulae (30)-(32). 

We obtain 

7T 

1 C TC , , 1 C 7U , _ 

a o = - ~dx + ~ 7 ^-0, 
n J 4 7i J 4 

7C 

71 

a n =^j{ I cos nx dx + I cosnxdxl =0 (n>0), 

4; I / / J 

n 

TC 

bn = T! sin/M?dfe+ I sin ^a? da?} = -r- (2 2 cos me) . 

4 I J J J 4:U 



o 
and so 6 n = for n even and b n = 1/w for ti odd. 
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Consequently, 
(42) f(a )^ + ^+*g2+... 

So, for x satisfying the condition < x < TT, /(#) may 
be replaced by JTT. 

In particular, substituting x = |TT we obtain the 
Leibniz expansion 

* = i_l+i_i+ 

4 3 ,5 7^'" 

which we already derived (cf. 7, (51)). 

(P) Let /(#) be the function with the period 2n defined 
as follows: 

f(x) = \x , when TT < # < TI, /( TT) = =/(TT) . 

We see easily that the function / defined in this way is 
piecewise continuous and piece wise monotone (cf. Fig. 29). 




Moreover, the condition (33) is satisfied. Thus, the func- 
tion / may be expanded in a Fourier series. 

Calculating the coefficients a n and b n according to the 
formulae (30)-(32) we find 

,. ox x 
(43) = 



Let us note that substituting x = |TT, we obtain the 
Leibniz expansion for JTC (just as in the previous example). 

(y) Let us expand the function f(x) = \x\ in the interval 
~n ^ x ^n. For other x the function is defined by the 
condition f(oo + 2mn) f(x). Hence it is a continuous func- 
tion on the whole X-axis. The graph of this function is 
a polygonal line. 

20 
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We now calculate the coefficients of the expansion 
in the Fourier series: 

TC TC 

1 /' ,, 2 /' 
a n = - \ \x \dx = -I xdx ~ TU, 

n J ' ' TcJ ' 

-TC 

TC TC 

a n = - |a?|cosna?<if# = - xw&nxdx = or 

7U .' ' TC J TCfr 

-TC 

according as n is even (>0) or odd. For, 

cccosnxdx = -xsmnx minxdx 
J n n J 

1 . ,1 

= - ftsiiiwrH - 



Similarly, we find that b n - J \x\ainnxdx = 0. Thus, 
, , T: 4 /cos# cosSa? , cosSo? , 



Let us note that by substituting x we obtain 
(45) 1 = ^ + ^.1+... 

Hence we obtain tlie Euler formula 



For, denoting by s the sum of this series, we have 
111 . 111 



i.e. f s = JTT, that is 6* = J?r 2 . 

(S) Let 7/ == cos to, TU < ^ < TC and let us assume that t 
is not an integer. The formulae (30)-(32) easily give: 

O r> a 

" 
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Thus, 



,._. . n . . . , cos 2^ 

(47) 

In particular, substituting x = TU and dividing both 
sides of identity (47) by sinrctf we obtain: 



t 

The formula (48) has the following interesting ap- 
plication. 

Let us write 



Given a number x satisfying the condition < x < 1, 
the series S(t) is uniformly convergent in the interval 

1 i 1 

^t ^x 9 since ~ - < ~ - ; and the series z - , 

~ 



is convergent, as is easily seen. 

Therefore the series S(t) may be integrated term by 
term in the interval < t < x. Since 



r 2< , , /, * 
J ^-p dt = - l s i- 

o v 

Hence (cf. 10.2, 12 and 5, (12)): 



-l 

On the other hand, 



TC ( 
J \ 



^ log^ = log 



nt in 
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Thus, 



- ,. , sin nt , 

= log lim log = log 

* B 6 



nt nx 

since 



.. . . ,. . . 

lim log = log lim = logl = . 

J- + K* J= + 7T* 

Taking into account the fact that the relation (48) 
holds for every t satisfying the inequality < t ^ x and 

that the function cotTrf has a right-side limit at the 



point 0, namely lim (cot<- - } = (cf. 8, (19)), 

f- + 0\ */ 

X X 

7t J (eotiet-^dt = - I 8(t)dt , 

' 



o 
i.e. 



therefore 



III iC 2 \ 

(49) sinToz? TCO? / / 11 -- ^ , 

= ' ' 



Let us note that by substituting in the formula (49)> 
x = ^, we obtain the Wallis formula already derived 
(cf. 10, (29)): 



- = / f 4n * -??4466 __41636 

(50) 2 ""i i 4n 2 -i "" I'S'S'S'S'T'""" s'iB'ss' 



Substituting ^ = J , we obtain 

TT 3.5 7.9 



. ... 8 12-12 

n = l 
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from which we conclude by (50) that 

/ 2 - 10 ' 10 _> 36 100 
V ~l-3'5-7'9-ll '"'"" 3 '35 *99"'" % 

Exercises on 11 

arc tan a?, 



- -n i -L r 

1. Evaluate J -r : , J 

J # 2 + 4' j 



2. Investigate the convergence of the integrals 

1 00 

I dx . I dx . 

J ]/x J I + x* 

o r o 

3. Let lim f(x) = and let a number c> be given. 

X 00 

Let us write 

a+cn 

a n = J f(x)dx. 

a-fc(n-l) 

If the series a 1 + a 2 +... is convergent, then the integral 

00 00 

/ f(x)dx is convergent, too, and is equal to J a n . 

a n l 

Apply the above theorem to the proof of the con- 
vergence of the integral 



o 

00 



r sm# , 

dx 

y x 



4 An integral J f(x)dx is called absolutely convergent, 

a 

oo 

if the integral / \f(x)\dx is convergent. Prove that an 

a 

absolutely convergent integral is also convergent in the 
usual sense. 



00 



^ 

5. Prove that the series ~i - -is convergent (ifc> a). 
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6. Prove that ( 1<*<1*> fe = . 

-i x 4 

(Expand the function under the sign of the integral 
in an infinite series and apply the formula (45)) 

7. Prove that - ?>2+<p~ 42 + - ^ j| ( cf - the for " 
mula (45)). 

8. Expand the functions: 

1) # 2 , 2) #cos#, 3) |sin#|, 
4) sinhte, 5) cosh^o? 
in Fourier series. 

9. Assuming that the system of functions / 1? / 2 , ... 

00 

is orthogonal and that the series /(#) = a/ n (^) is 

?i-i 

uniformly convergent (in the considered interval aft), 
calculate the coefficients a n (by means of the functions 

/, A, /,-) 
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